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ABSTRACT 

The  purpose  of  this  study  was  to  identify  predictors  of  success  in 
the  USAF  Medical  Service  Specialist  school  and  to  explore  those  charac¬ 
teristics  that  best  differentiate  Failures  and  Graduates.  Composite 
scores  from  the  Aimed  Services  Vocational  Aptitude  Battery  (ASVAB 
Form  6  and  7),  a  course-developed  mathematics  pretest  score,  a  general 
intelligence  score,  and  student  demographics  were  used  as  predictors  of 
the  dlcotomous  criterion  for  784  enlisted  personnel  entered  into  this 
occupational  specialty.  Group  mean  differences,  correlation  analysis, 
and  the  development  of  a  linear  discriminant  function  (LDF)  were 
accomplished  to  determine  those  variables  that  best  differentiated  the 
two  groups.  Results  of  these  analyses  Indicate  that  the  most  powerful 
predictor  of  graduation  and  discrimination  between  Graduates  and 
Failures  was  the  course-developed  mathematics  pretest.  General  intel¬ 
ligence,  electrical  aptitude,  and  age  appear  to  offer  additional 
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predictive  information.  Distributions  of  the  standardized  discriminant 
scores  in  reduced-space  appear  to  indicate  a  significant  deviation  from 
a  normal  distribution  for  the  Failure  population  based  on  the  variables 
studied  .^Recommendations  are  given  that  might  help  change  the  shape 
towards  that  of  a  normal  distribution  by  the  inclusion  of  noncognitive 
variables.  Four  separate  classification  schemes  were  utilized  with 
cr jss-validation  accomplished  on  a  sample  held  out  of  the  original 
computations  of  the  IDF.  Correct  classification  for  Failures  ranged 
between  31%  to  67%  and  for  Graduates  between  89%  to  94%.  The  two 
optimal  classifications,  under  the  criterion  of  a  minimum  of  misclassifi- 
cation  for  the  two  groups,  was  accomplished  via  a  graphic  cutoff  score 
procedure  and  when  unequal  a  priori  odds  of  group  membership  are  taken 
into  account  in  the  classification  functions.  The  use  of  a  LDF  is 
discussed  in  light  of  a  proposed  optimal  aptitudes  requirements  system 
and  for  managerial  control  of  a  remedial  program. 
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variables.  Four  separate  classification  schemes  were  utilized  with 
cross-validation  accomplished  on  a  sample  held  out  of  the  original 
computations  of  the  LDF.  Correct  classification  for  Failures  ranged 
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optimal  classifications,  under  the  criterion  of  a  minimum  or  misclassifi- 
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procedure  and  when  unequal  a  priori  odds  of  group  membership  are  taken 
into  account  in  the  classification  functions.  The  use  of  a  IDF  is 
discussed  in  light  of  a  proposed  optimal  aptitudes  requirements  system 
and  for  managerial  control  of  a  remedial  program. 


TABLE  OF  CONTENTS 


Page 

ACKNOWLEDGEMENTS .  iii 

ABSTRACT .  iv 

LIST  OF  TABLES . viii 

LIST  OF  APPENDICES .  ix 

LIST  OF  FIGURES .  x 

INTRODUCTION .  1 

REVIEW  OF  LITERATURE .  6 

History .  6 

Validity  of  Occupational  Aptitude  Tests .  8 

Air  Force  Aptitude  Tests  Utilized  in  Selection  and  Placement....  II 

Military  Prediction  Studies .  15 

Prediction  in  the  Clinical  Laboratory .  17 

METHOD .  24 

Sub j  ects .  24 

Measures . 24 

Criterion . 26 

Analyses .  26 

RESULTS .  29 

Evaluation  of  Means .  29 

Validity  Correlations .  33 

Discriminant  Model  Development .  36 


Subsample  Selection 
Procedure . 


38 

38 


TABLE  OF  CONTENTS  (Continued) 


Distribution  of  the  Discriminant  Scores .  43 

Classification.... . 47 

Subsidiary  Analysis .  51 

DISCUSSION .  57 

Summary  of  Results .  57 

Limitations . 61 

Suggestions  for  Further  Research .  63 

Conclusions .  64 

APPENDIX .  66 

LIST  OF  REFERENCES  CITED . 133 


vii 


LIST  OF  TABLES 


Table 

1. 

2. 

3. 

4. 

5. 

6. 

7. 

8. 

9. 

10. 

11. 

12. 


List  of  Variables .  27 

Means,  Standard  Deviations,  and  Significance  Testing  for 
Differences  Between  All  Groups... .  30 

Differences  Between  all  Pairs  of  Means .  31 

Means,  Standard  Deviations ,  and  Significance  Testing  for 
Differences  Between  Graduates  and  Failures  (Phase  I  and 
Phase  II  Combined) . . . 32 

Correlations  Between  Predictor  Variables .  34 

Point  Biserial  Correlations  and  Partial  Correlations  to 
Graduation .  36 

Group  Means  and  Standard  Deviations  of  the  Variables  Used 

in  the  Sub  sample  for  LDF  Development .  39 

Methods  to  Determine  Significance  of  Variables  in 
Discrimination .  41 

Linear  Classification  with  Equal  and  Unequal  a  priori  Results..  49 

Quadratic  Classification  Results... .  50 

Graphic  Classification  Results .  50 

Effectiveness  of  Classification  Results  Compared  to  Chance .  51 


i 


LIST  OF  APPENDICES 


Appendix  Page 

A.  Armed  Services  Vocational  Aptitude  Battery  (ASVAB) ,  Forms  5 

thru  10:  General  information  on  Composites  and  Subtests .  67 

B.  Computation  of  the  Linear  Discriminant  Function  for  the 

Itoo-Group  Case .  71 

C.  SPSS  Procedure  for  the  Classification  of  Cases .  75 

D.  Computer  Input  and  Output  for  the  Linear  Equal  a  priori 

Classification .  73 

E.  Computer  Input  and  Output  for  the  Linear  Unequal  (Size) 

priori  Classification. . . . 104 

F.  Computer  Input  and  Output  for  the  Quadratic  Equal  a 

priori  Classification . Ill 

G.  Computer  Input  and  Output  for  the  Subsidiary  Analysis . 121 


am** 


nafcjfcdjfaiiwfciifex  »»<>■  - 


LIST  OF  FIGURES 


Figure 


] 


1.  Frequency  histogram  of  Graduate  (Group  1)  discriminant 
scores . . . . . 

Frequency  histogram  of  Failure  (Group  2)  discriminant 
scores . 

Scaled  drawing  of  Graduate  and  Failure  histograms 
superimposed . . . . . 

Frequency  histogram  of  Graduate  (Group  1)  discriminant 
scores :  subsidiary  analysis . . 

Frequency  histogram  of  Failure  (Group  2)  discriminant 
scores:  subsidiary  analysis . 


INTRODUCTION 


Vocational  counselors  and  organization  selection  and  placement 
personnel  have  one  desire  that,  in  the  majority  of  cases,  would  signi¬ 
ficantly  improve  their  task.  That  is  to  identify  a  specific  predictor 
of  success  for  the  respective  position  available.  This  is  especially 
important  for  the  young  adult  whose  job  experiences  may  be  limited. 

In  many  cases,  the  career  decisions  made  early  in  life  are  without 
much  information  about  the  tasks  required  on  the  job  and  researchers 
have  found  this  to  be  the  rule  rather  than  the  exception  in  the  medical 
technology  career  field  [Zufall,  1976;  Youse  and  Clark,  1977;  Gleich, 
1978] .  Unfulfilled  expectations  and  inadequate  abilities  or  aptitudes 
inevitably  foster  feelings  of  job  dissatisfaction,  lessened  motivation, 
poor  performance,  or  high  attrition  [Porter  and  Steers,  1973;  Margolis 
e£  al. ,  1974;  Hoiberg  and  Pugh,  1978],  Any  one  of  these  conditions 
will  exact  a  personal  and  organizational  cost  -  a  cost  directly  mani¬ 
fested  in  higher  budgets  and  decreased  organization  effectiveness. 

Concern  with  the  prediction  of  training  and  job  success  in  the 
military  has  increased  during  recent  years.  Selective  budgetary  con¬ 
straints  arising  from  Congressional  action,  the  "all  volunteer  military", 
continued  shortages  of  career  oriented  personnel,  guaranteed  job 
placement,  and  high  attrition  rates  have  necessitated  valid  and  reliable 
placement  procedures.  The  Importance  of  the  process  can  be  appreciated 
by  examining  the  possible  costs  of  one  training  failure.  Training 
facilities  are  located  throughout  the  country.  Retraining  of  the 
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individual  will  convey  costs  across  multiple  budgets.  Interservice 
support  may  be  required  to  move  the  airman,  his/her  family  and  belongings 
to  another  area  of  the  country.  The  strict  bureaucratic  nature  of  the 
organization  requires  lengthy  administrative  procedures,  increased 
special  instruction,  and  remedial  Interviews  to  assure  the  student  fair 
treatment.  Class  slots  are  lost  and  the  Air  Force  yield  in  productive 
employment  is  lowered.  Also,  the  terminated  student  may  suffer.  Per¬ 
sonal  self  esteem  may  be  lowered,  achievement  motivation  decreased,  and 
the  unmet  expectations  might  arouse  the  desire  to  "get  out"  which  can 
be  a  multiplicative  function  of  cost  for  all  concerned.  These  implica¬ 
tions  of  poor  placement  mandate  the  need  for  a  prediction  of  successful 
placement  that  not  only  addresses  the  knowledge  of  an  individual's 
employment  interests,  but  also  an  accurate  estimate  of  the  person's 
probability  of  successful  training  and  job  performance.  It  has  been 
stated  that  the  most  objective  may  to  assess  probabilities  of  success 
are  through  the  use  of  testing  procedures.  However,  this  .  .  . 

"...  is  not  to  say  that  tests  have  no  faults,  for  they 
have  many.  Nevertheless,  even  though  under  some  circumstances 
they  favor  certain  classes  of  individuals  rather  than 
others,  they  are  more  Impartial.  Although  the  descriptions 
of  the  abilities  and  traits  they  give  of  one  and  the  same 
individual  do  vary  from  one  occasion  to  another,  these 
descriptions  are  given  with  greater  quantitative  precision. 

And  even  though  our  knowledge  about  the  usefulness  of  the 
various  sorts  of  tests  as  aids  in  making  occupational 
choices  is  woefully  Incomplete,  it  is  vast  compared  with 
our  knowledge  about  other  procedures  and  devices" [Ghiselll, 

1966]. 

A  testing  approach  to  placement  has  been  the  method  of  choice  by 
the  United  States  Air  Force  (USAF)  since  its  inception  in  1948.  Guinn, 
et  al.  [1970b],  in  reviewing  Air  Force  selection  procedures,  concluded 


3 


that  aptitude  test  scores  were  the  best  indicators  that  the  USAF  could 
use  to  predict  success  in  technical  training  and  Goslln  [1964]  judged 
it  likely  that  tests  play  a  much  greater  role  in  military  personnel 
allocation  than  in  any  other  occupational  area.  Thus,  it  would  be 
appropriate  that  research  be  aimed  at  maximizing  the  efficiency  and 
effectiveness  of  the  aptitude  measures  used  in  USAF  placement  procedures. 
Methodological  approaches  for  establishing  an  optimal  aptitudes  require¬ 
ments  system  were  offered  by  Maglnnis  et  al.  [1975].  Some  specifics 
of  such  a  system  included: 

"Establish  and  maintain  an  optimal  baseline  set  of  valid 
aptitude  requirements  and  quotas  that  meets  personnel 
system  needs.  .  . 

Be  able  to  specify  short-term  aptitude  requirements  dif¬ 
ferent  from  the  optimal  to  allow  total  manpower  quotas  to 
be  met  .  .  . 

Be  able  to  respond  to  long  term  personnel  system  changes 
with  changes  to  the  optimal  baseline  set  of  aptitude 
requirements,  .  . 

Meet  needs  of  aptitude  requirements  system  personnel  for 
simplicity  of  administration,  scoring,  and  Interpreting 
aptitude  measures  while  meeting  rigorous  standards  of 
prediction.  .  . 

Encourage  the  utilization  of  lower  aptitude  personnel 
without  compromising  mission  effectiveness.  .  . 

Deemphasize  the  role  of  purely  secondary  needs  (e.g. 
academic  proficiency)  in  setting  selection  and  assign¬ 
ments  criteria  and  emphasize  the  roles  of  those  needs  that 
contribute  directly  to  mission  success"  [Maglnnis  et  al. , 

1975]. 

In  relation  to  training,  they  recommend  that  a  survey  be  made  of  the 
characteristics  of  present  training  courses  to  determine  the  aptitude 
types  and  levels  required  to  pass.  As  of  this  date,  little  research 
has  been  accomplished  in  this  area. 
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This  study  Is  aimed  at  examining  the  "predictive  characteristics" 
of  courses  J3ABR90430  and  J5A2090450,  Medical  Laboratory  Specialist  at 
the  USAF  School  of  Health  Care  Sciences,  Sheppard  AFB ,  Texas.  This 
occupational  field  can  be  chosen  by  a  newly  enlisted  member  (assuming 
available  quotas)  by  meeting  the  following  mandatory  requirements: 

1.  Completion  of  high  school  subjects  In  chemistry  and  algebra. 

2.  Normal  color  vision  as  specified  by  Air  Force  Regulation 
160-43. 

3.  A  minimum  aptitude  level  of  60  on  the  General  Aptitude  Index 
(GI)  of  the  Armed  Services  Vocational  Aptitude  Battery  (ASVAB) 
[AFR  39-1 (C7),  Attachment  50,  30  April  1980] 

The  course  consists  of  two  phases:  Phase  I  ".  .  .  is  a  17-week  course 
which  trains  students  In  the  basic  theory  and  skills,  collection,  pre¬ 
paration  and  analysis  of  biological  fluids  and  other  substances  by 
standard  procedures  used  in  medical  laboratories  .  .  .  Emphasis  Is 
placed  on  routine  methodology  employed  in  the  fields  of  urinalysis,  blood 
banking,  serology,  clinical  chemistry,  bacteriology,  mycology,  and 
parasitology"  [Carroll,  1980].  Phase  II  is  a  36-week  course  conducted 
at  specific  USAF  hospitals  primarily  focused  at  instruction  of  clinical 
applications  in  the  major  fields  of  the  laboratory. 

Information  available  to  course  instructors  include:  ASVAB  com¬ 
posite  scores  in  Mechanical  (MI),  Administrative  (AI) ,  General  (GI), 
and  Electrical  (EL)  aptitudes;  the  Air  Force  Qualifying  Test  (AFQT) ;  a 
general  Mathematics  Pretest;  and  student  demographics.  Based  on  this 
information,  the  purpose  of  this  Btudy  is  to: 

1.  perform  an  exploratory  study  of  those  variables  presently 
available  to  course  Instructors  in  relation  to  a  criterion 
of  successful  completion  of  Medical  Laboratory  Specialist 
(MLS)  technical  training. 
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2.  examine  the  utility  of  a  discriminant  model  for  the  predic¬ 
tion  of  graduation  from  MLS  technical  training, 

3.  conduct  a  classification  and  cross-validation  procedure 
to  estimate  the  stability  of  the  model  on  an  independent 
sample  and  to  determine  an  estimate  of  the  expected 
misclassification  rate, 

4.  evaluate  the  appropriateness  of  the  model  in  light  of  the 
optimal  aptitude  requirements  system  discussed  by  Maginnis 
et  al.  [1975]. 


REVIEW  OF  LITERATURE 


History 

Any  effort  designed  to  selectively  place  an  individual  in  a 
specific  catagory  or  treatment  based  on  traits  the  person  possesses 
requires  some  explicit  assumptions  about  the  nature  of  man.  First,  we 
must  assume  there  are  differences  between  human  beings.  Second,  that 
these  differences  can  be  measured  and  evaluated.  And  third,  that  with 
some  probability  (at  least  better  than  chance)  we  can  successfully 
predict  a  future  outcome.  In  vocational  prediction  these  differences 
were  first  classified  as  abilities.  A  review  of  the  historical  develop¬ 
ment  of  measuring  human  differences  is  given  by  Dunnette  [1966]  in 
Personnel  Selection  and  Placement.  His  review  is  highlighted  here. 

Plato  was  probably  the  first  person  to  write  about  differences  in 
abilities  and  the  need  for  an  accurate  system  of  assigning  persons  to 
particular  occupations  so  that  they  could  maximally  contribute  to 
society.  However,  adequate  testing  of  human  differences  had  to  wait 
until  appropriate  mathematical  models  could  be  developed  to  objectively 
assess  differences.  In  1869,  Sir  Frances  Galton  in  his  book  Hereditary 
Genius  laid  the  foundation  for  these  studies  by  developing  a  system 
for  classifying  individuals  according  to  their  abilities.  He  concluded 
that  all  human  differences  were  distributed  according  to  the  known  fre¬ 
quencies  of  the  normal  distribution  by  a  standard  score.  With  this 
theory,  researchers  began  to  measure  human  differences  reflected  in 
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dimensions  such  as  sensory  and  motor  testing.  However,  Alfred  Binet, 

in  1895,  argued  that  more  complex  mental  processes  such  as  memory, 

imagery,  imagination,  attention,  and  comprehension  should  be  studied. 

In  1905,  he  published  the  first  Binet  Test  of  Intelligence.  Lewis 

Terman,  at  Stanford  University,  expanded  on  the  Binet  Test  and  published 

his  Stanford-Binet  in  1916.  Scores  on  this  test  were  expressed  as  an 

• 

Intelligence  Quotient  (IQ) .  Utilizing  more  complex  statistical  models, 
Charles  Spearman  [1927]  proposed  that  humans  possessed  not  only  a  general 
intelligence  factor  but  also  a  group  of  specific  abilities.  Factor 
analytic  studies  performed  by  L.  L.  Thurstone  [1938]  and  G.  P.  Guilford 
[1956]  extracted  several  factors  that  they  felt  accounted  for  the  range 
of  observable  differences  among  individuals.  Thurstone  grouped  the  major 
cognitive  abilities  of  man  into  seven  catagories;  verbal  comprehension, 
word  fluency,  number  aptitude,  inductive  reasoning,  memory,  spatial 
aptitude,  and  perceptual  speed.  Guilford  saw  mental  organization  lying 
along  three  dimensions;  operations,  contents,  and  products.  Helmstadter 
[1964]  summarized  J.  P.  Guilford's  conclusions  as  such:  a  person  per¬ 
forming  successfully  all  the  operations  containing  semantic  content 
would  be  said  to  have  high  verbal  ability;  a  person  performing  all 
operations  containing  symbolic  content  would  have  high  mathematics 
ability;  one  performing  effectively  operations  with  figural  content 
would  have  high  spatial  or  artistic  ability;  and  a  person  who  could 
recognize,  remember,  solve,  and  evaluate  contents  involving  interpersonal 
behavior  would  be  said  to  possess  high  social  ability.  Vernon  [1960] 
pictured  Individual  differences  in  cognitive  abilities  as  resembling 
a  branching  tree  of  General  Ability.  The  two  main  branches  represented 
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Academic  Ability  and  Practical  Ability.  The  academic  branch  had 
smaller  branches  of  Reasoning,  Numerical,  and  Verbal  Abilities.  The 
practical  branch  had  branches  of  Perceptual,  Mechanical,  and  Spatial 
Abilities. 

The  development  of  present  aptitude  tests  have  been  based  on  such 
conceptualizations.  Thorndike  and  Hagen  [1977]  have  noted  that  it  was 
through  the  "...  theoretical  research  on  the  nature  of  abilities  on 
the  one  hand  and  applied  research  on  the  validity  of  specific  tests  for 
specific  jobs  on  the  other,  psychologists  have  been  guided  in  the 
design  of  aptitude  test  batteries  for  use  in  education  and  vocational 
guidance  and  in  personnel  selection  and  classification." 

Validity  of  Occupational  Aptitude  Tests 

In  evaluating  the  usefulness  of  tests  as  aids  in  making  occupa¬ 
tional  choices,  the  major  concern  is  the  extent  to  which  they  measure 
the  abilities  and  traits  important  for  success  in  the  jobs  under 
consideration. 

Ghiselli  [1966]  sees  face  validity  for  occupational  aptitude 
testing  most  likely  originating  with  the  Great  War  of  1914-1918. 
Standard  tests  were  utilized  to  induct  and  assign  thousands  of  soliders 
based  on  intelligence,  aptitudes,  and  occupational  skills.  He  sees 
the  relative  success  of  this  program  as  moving  testing  to  a  high  degree 
of  sophistication,  but  also  inferring  a  substantial  over-rated  accuracy 
to  the  layman.  Objective  validity  measures  have  depended  on  the  use  of 
statistical  correlation.  As  such,  the  occupational  validity  of  a  test 


is  the  accuracy  with  which  the  test  scores  predict  the  criterion.  The 
higher  the  correlation,  the  higher  the  validity. 


Research  in  the  development  and  utilization  of  tests  has  been  rather 
extensive.  The  technical  considerations  of  psychometric  theory  are 
presented  by  various  authors  [Gulllksen,  1950;  Lord,  1952;  Guilford, 

1954;  Cronback  et_  al . ,  1972].  The  most  intensive  integration  of 
available  information  and  data  on  the  validity  of  occupational  aptitude 
testing  is  given  by  Ghiselli  [1966]  in  The  Validity  of  Occupational 
Aptitude  Tests.  The  validity  correlations  that  he  presents  are  based 
on  the  criterion  of  training  success  and  level  of  job  proficiency.  His 
conclusions  are  presented  here. 

Ghiselli  concludes  that  there  exist  three  dimensions  in  terms  of 
occupational  validity;  one  of  intellectual  abilities  and  perceptual 
accuracy,  one  of  motor  abilities,  and  one  of  mechanical  and  spatial 
abilities.  The  first  two  are  somewhat  related  but  relatively  indepen¬ 
dent  of  the  third.  He  also  addresses  the  predictive  power  of  tests  in 
relation  to  the  criterion  of  training  and  that  of  job  proficiency,  with 
the  following  conclusions: 

1.  tests  of  perceptual  accuracy  and  motor  abilities  are 
essentially  the  same  for  both  criterion; 

2.  tests  of  Intellectual  abilities,  i.e. ,  intelligence, 
and  in  particular,  arithmetic  tests,  are  much  more  pre¬ 
dictive  of  training  than  of  proficiency  criteria; 

3.  tests  of  spatial  and  mechanical  abilities  are  more  pre¬ 
dictive  of  trainablllty; 

4.  general  job  success  seems  least  well  predicted  by  tests 
of  motor  abilities  and  best  by  tests  of  intellectual 
abilities. 
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Ghiselli  did  not  offer  any  conclusions  about  personality  or  interest 
tests  since  the  tests  were  of  such  a  heterogenous  group  that  his  use 
of  a  mean  validity  coefficient  would  have  been  misleading.  The  rela¬ 
tionship  between  mean  validity  coefficients  for  training  and  job  pro¬ 
ficiency,  for  all  occupations  taken  together,  was  .14.  Hence,  he  infers 
that  a  test  may  have  relatively  high  validity  for  training  on  a  given 
job  and  at  the  same  time  low  validity  for  job  proficiency  [Ghiselli, 
1966].  Studies  presenting  similar  results  on  training  versus  job 
proficiency  are  given  by  Rapes  [1971]  and  Herr  et  al.  [1973]. 

The  manual  for  the  General  Aptitude  Test  Battery  (GATB)  has 
reported  various  correlations  of  the  GATB  scores  with  success  either  in 
training  or  on-the-job.  Correlations  between  the  aptitude  tests  and 
their  criterion  were  the  basis  for  the  establishment  of  qualifying 
scores  that  most  effectively  differentiated  successful  and  unsuccessful 
workers.  Comparing  the  correlations  arrived  at  by  Ghiselli  with  those 
of  the  GATB,  it  can  be  noted  that  Ghiselli’ s  validity  coefficients  are, 
in  general,  less  than  that  reported  by  the  GATB.  One  possible  explana¬ 
tion  is  given  by  Thorndike  and  Hagen  [1977].  They  felt  that  the  pooled 
data  used  by  Ghiselli  may  have  diminished  overall  correlations  by  com¬ 
bining  various  jobs  into  fewer  clusters  than  the  GATB.  However,  it  is 
also  possible  that  such  a  1 irge  combination  of  jobs  and  coefficients 
provide  a  more  stable  picture  of  the  true  validity  of  occupational 
aptitude  testing.  They  further  note  that  the  GATB  data  is  less  than 
ideal  since  it  is  concurrent  (rather  than  predictive) ;  the  samples 
were  small,  the  samples  may  have  been  from  a  single  plant  or  company, 
and  there  was  no  independent  cross-validation. 
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Ghiselli  updated  his  1966  summary  of  the  occupational  validity  of 
tests  in  1973.  The  range  of  validity  coefficients  for  all  jobs  studied 
were:  .28-. 65  for  training,  and  .24-. 46  for  job  proficiency.  These 
correlations  are  based  on  a  single  test  with  the  criterion,  combina¬ 
tions  of  particular  tests  may  increase  validity  [Ghiselli,  1973]. 

An  excellent  review  of  technical  and  environmental  considerations 
that  may  influence  the  overall  validity  of  psychological  tests  in 
personnel  selection  and  placement  is  given  by  French  [1978] .  He  dis¬ 
cusses  the  impact  of  criterion  choice,  test  reliability,  moral  and 
legal  issues,  labor-management  relations,  technology,  motivation  and 
others,  in  test  utilization.  Thorndike  [1949]  has  noted  that  there  is 
no  easy  road  to  accurate  placement  decisions  and  that  the  "... 
worker  in  the  field  is  continuously  concerned  with  testing,  verifying, 
and  in  improving  the  adequacy  of  his  procedures." 

Air  Force  Aptitude  Tests  Utilized 
in  Selection  and  Placement 

From  1959  to  1968,  the  Airman  Qualifying  Exam  (AQE)  was  the  apti¬ 
tude  battery  used  by  the  USAF.  Tupes  et  al.  [1967]  in  analyzing  certain 
methods  to  improve  the  AQE  have  summarized  the  battery.  The  AQE  became 
operational  for  testing  of  primary  aptitudes  used  for  screening, 
selective  enlistment  and  classification  of  basic  trainees  in  1959.  It 
consisted  of  200  aptitude  items  which  were  summed  to  yield  four  aptitude 
composites;  General  (GI) ,  Administrative  (AI) ,  Mechanical  (MI),  and 
Electronics  (EL).  Qualifying  scores  for  each  composite  were:  40  on  the 
GI,  AI,  and  MI;  and  60  on  the  EL.  An  acceptable  score  on  any  one  or 
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more  composites  (above  cutoff)  allows  the  applicant  to  enlist.  The 
person  is  then  assigned  an  area  for  which  the  person  is  qualified, 
has  an  interest,  and  for  which  a  quota  exists. 

A  number  of  follow-up  studies  were  accomplished  for  predicting 
performance  in  technical  training  with  correlation  to  final  grades 
ranging  between  .6  to  .7  [Lecznar,  1963;  McReynolds,  1963;  Lacznar, 

1964;  Madden  and  Lecznar,  1965].  Test  bias  was  also  evaluated.  Tupes 
et  al.  [1967]  in  analyzing  approximately  73,000  enlistees  during  1961 
found  that  somewhat  different  patterns  of  aptitudes  and  individual 
background  were  apparent  within  the  broad  career  groups  established. 

They  concluded  that  separate  aptitude  composites  for  each  course  would 
increase  validity.  Lecznar  [1962],  Lecznar  [1965]  and  Tupes  [1965] 
found  that  individuals  from  different  geographical  areas  differed  con¬ 
siderably  on  aptitudes  and  other  characteristics  such  as  education  and 
motivation  to  enlist.  Gordon  [1953]  concluded  that  prediction  of  tech¬ 
nical  school  grades  were  essentially  the  same  for  black  and  white 
students.  However,  Guinn  _et  al .  [1970a]  in  a  study  using  1,900  airmen 
found  significant  interaction  between  test  scores  and  race.  They  found 
educational  differences  to  be  most  highly  related  to  performance  on  tests 
comprising  general  intelligence,  with  race  differences  having  highest 
relationships  with  the  mechanical  composite  scores.  Differences  in 
geographical  area  were  found  to  Interact  with  a  variety  of  the  subtests. 
Guinn  e£  al_.  [1970b]  followed  their  initial  study  by  examining  19,734 
technical  graduates  in  30  different  training  courses  to  assess  cultural 
subgroup  differences.  They  found  that  the  performance  of  blacks  and 
high  school  non-graduates  tended  to  be  overestimated  in  prediction 
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models  as  were  Individuals  from  the  North-Northeast  area.  Persons  from 
the  Far  West-Pacific  Coast  area  tended  to  be  underpredicted. 

In  1968,  the  AQE  was  replaced  by  the  Armed  Services  Vocational 
Aptitude  Battery  (ASVAB)  in  the  military  high  school  testing  program 
[Vitola  and  Alley,  1968].  The  ASVAB  became  the  instrument  for  aptitude 
testing  of  all  Air  Force  enlistees  in  1973  and  consisted  of  four  apti¬ 
tude  composites  and  a  general  intelligence  composite.  Development  of 
ASVAB  Forms  1  through  4  is  discussed  by  Jensen  and  Valentine  [1976]  and 
Bayroff  and  Fuchs  [1970].  Vitola  and  Wilbom  [1971],  in  analyzing  bias 
in  the  earlier  forms,  found  females  scored  slightly  higher  than  males 
on  the  general  intelligence  composite  (AFQT) .  Valentine  and  Massey 
[1976]  found  that  females  scored  higher  on  the  General  and  Administrative 
composites,  while  males  scored  higher  on  the  Mechanical  and  Electrical 
composites.  The  early  studies  by  Guinn  were  substantiated  by  Valentine 
[1977]  in  relation  to  demographic  influence.  However,  in  relation  to 
minority  overprediction,  he  noted  that  adjustments  to  prediction  equa¬ 
tions  would  essentially  reduce  the  qualification  rates  for  these 
individuals.  Furthermore,  he  found  the  use  of  education  background  did 
contribute  to  prediction  accuracy  in  some  cases,  but  was  subject  to  such 
bias  in  reporting  that  utilization  in  general  prediction  models  did  not 
seem  appropriate. 

ASVAB  Forms  5,  6,  and  7  were  developed  in  1976  [Jensen  et  al. , 

1976].  Kettner  [1976]  compared  the  ASVAB  Form  5  with  the  GATB  and  the 
Differential  Aptitude  Tests  (DAT).  Criticism  of  the  ASVAB  test-retest 
reliabilities  was  given  by  Valentine  and  Massey  [1976].  They  concluded 
that  the  data  strongly  suggested  non-standard  operational  testing 
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during  that  time  frame.  The  greatest  amount  of  criticism  has  come 
from  researchers  on  the  use  of  ASVAB  Form  5  for  high  school  vocational 
counseling.  Vanderploeg  and  Mueller  [1978]  felt  the  studies  cited  to 
support  the  use  of  ASVAB  Form  5  were  poorly  executed  and  utilized  sample 
sizes  that  were  too  small.  On  factor  analysis  of  the  subtests,  they 
could  only  extract  two  factors.  Factor  1  accounted  for  51%  of  the  total 
variance  and  Factor  2  less  than  9%.  Factor  1  had  high  loadings  on  2/3 
of  all  subscales  and  included  all  the  vocational  subscales.  Factor  2 
was  associated  with  mathematics  ability.  Cronbach  [1978]  argued  that  some 
subtests  were  measures  of  experience  and  that  the  prediction  of  occupa¬ 
tional  aptitude  based  on  information  tests  were  inappropriate.  He 
referenced  Fletcher  and  Ree  [1976]  and  noted  that  two  major  factors 
appear  to  emerge  and  that  the  Mechanical  composite  appeared  to  be  a 
spatial  plus  general  composite  rather  than  mechanical.  Valentine  and 
Mathews,  in  response  to  this,  offered  evidence  from  their  study  in  1977 
to  support  the  job  specific  validity  of  the  mechanical  composite.  They 
noted  validity  correlations  of  .29,  .34,  and  .52  for  three  mechanical 
training  programs  with  the  mechanical  composite.  Validity  correlations 
for  the  mechanical  composite  with  training  success  in  seme  administra¬ 
tive  specialties  did  less  well.  Slmm  and  Truss  [1979]  in  examining 
the  normalization  procedure  used  for  ASVAB  Forms  6,  7  noted  errors  in 
the  normalized  scores.  The  percentile  scores  were  found  to  be  higher 
than  actuality;  however,  the  ranking  of  individuals  remained  the  same. 
Correction  of  the  reported  normalized  scores  has  been  difficult  due  to 
a  nonlinear  relationship  between  actual  and  reported  scores. 


ASVAB  Forms  8,  9,  and  10  were  developed  and  standardized  by 
Fruchter  [1977],  They  became  operational  in  October,  1980,  and  are 
presently  in  use.  They  are  not  affected  by  the  normalization  error  noted 
in  Forms  5,  6,  and  7.  A  listing  of  the  subtests  and  composites  for  the 
most  recent  ASVAB  Forms  (5,6,7,8,9,10)  can  be  found  in  Appendix  A. 

Military  Prediction  Studies 

Air  Force  studies  in  predicting  success  have  almost  exclusively 
relied  on  the  criterion  of  technical  course  grades.  Leisey  and  Guinn 
[1977]  developed  a  model  to  help  identify  potential  student  failures  in 
three  medical  specialties.  Criterion  data  included  type  of  eliminee 
(i.e.,  academic,  medical,  other),  phase  test  scores,  and  final  grade. 
Independent  variables  included;  ASVAB  composites,  Otis-Lennon  Mental 
Ability  Test,  Vocabulary  score  from  the  Word  Clue  Test,  two  reading 
ability  scores,  years  of  education,  specialty  preferred,  whether 
guaranteed  job  placement,  high  school  courses  completed,  age,  and  years 
of  active  service.  Percentages  of  eliminees  correctly  predicted  ranged 
from  8%  to  34%.  Linear  multiple  regression  models  were  developed  for 
full  and  restricted  variable  usage.  It  was  noted  that  statistically 
significant  increases  in  the  multiple  correlation  were  found  by  utilizing 
the  full  model  and  warranted  the  use  of  the  commercial  tests  in  predic¬ 
tion. 

Holberg  and  Pugh  [1978]  utilized  39  variables  comprised  of  life 
history  items,  motivation  items,  expectations,  personality,  and  aptitudes 
to  predict  attrition  for  7,923  enlisted  Navy  personnel  within  seven 


occupational  specialties.  The  most  powerful  predictors  included:  edu¬ 
cation  level,  number  of  school  expulsions  and  suspensions,  two  sub¬ 
scales  of  the  Ccmrey  Personality  Test,  arrests,  age,  aptitudes,  and 
expectations. 

Frederico  and  Landis  [1979a]  proposed  the  use  of  a  discriminant 
model  to  predict  the  dicotomous  criterion  of  Graduates  and  Failures  in 
the  Navy's  Basic  Electricity  and  Electronics  school.  Their  sample  con¬ 
sisted  of  207  students,  with  independent  variables  consisting  of  measures 
of  cognitive  styles,  abilities,  and  aptitudes.  The  data  demonstrated  that 
aptitudes  alone  predicted  better  than  abilities  or  styles  alone  or  in 
combination.  Optimum  classification  was  obtained  utilizing  aptitudes 
plus  abilities  or  aptitudes  plus  abilities  plus  styles.  As  noted  by 
the  authors,  cross-validation  was  needed.  In  further  studies,  Frederico 
and  Landis  [1979b]  found  successful  completion  of  the  course  to  be  depen¬ 
dent  upon  space  perception,  general  reasoning  ability,  and  scores  in 
mathematics,  general  science  and  automobile  information. 

A  screening  methodology  for  entry  into  the  Security  Police  field 
was  presented  by  Guinn  et  al.  [1977] .  They  concluded  that  aptitudes, 
interests,  and  personal  history  data  demonstrated  predictive  value  in 
selection.  Mathews  and  Jensen  [1977]  found  the  General  composite 
of  the  ASVAB  to  correlate  significantly  with  final  grades  in  a  Dental 
Laboratory  Specialist  course.  A  perceptual  test  composite  was  found  to 
correlate  with  laboratory  success.  Other  studies  that  have  utilized  the 
ASVAB  include;  Nuanez  [1977],  in  which  the  General  composite  was  a 
fairly  good  predictor  of  grade  point  average  (GPA)  in  a  high  school,  and 
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Henegar  [1975] ,  where  the  General  and  Electrical  aptitude  composites 
had  the  greatest  degree  of  association  with  final  grades  in  an 
Electronics  Principles  course. 

Roark  [1981b]  developed  a  model  from  113  student  test  scores  in 
the  USAF  Medical  Laboratory  Specialist  course  utilizing  a  precourse  math 
test  and  three  arithmetic  composites  from  the  Tests  of  Basic  Education 
(TABE) .  The  criterion  under  study  was  the  first  chemistry  exam 
(Block  1-1) .  Cross-validation  on  an  independent  sample  of  52  students 
was  accomplished  with  an  88%  predictive  accuracy  noted. 

Prediction  In  the  Clinical  Laboratory 

A  review  of  early  studies  in  aptitude  and  ability  testing  in  the 
clinical  laboratory  has  been  accomplished  by  Zufall  [1974],  Her  review 
is  presented  here. 

Zufall  notes  that  the  first  published  work  in  aptitude  testing  was 
accomplished  by  Strassel,  in  1956.  She  utilized  the  Guilford-Zimmerman 
Temperament  Survey,  the  Judgment  and  Comprehension  Test  from  the 
Flanagan  Aptitude  Classification  Battery  for  Biological  Sciences  and  the 
ACE  for  guidance  counseling  of  students.  In  1958,  the  Colorado  Depart¬ 
ment  of  Employment  developed  a  specific  aptitude  battery  for  Medical 
Technologists  to  be  used  in  the  GATB.  The  aptitudes  chosen,  based  on 
mean  scores  of  participants  and  lowest  standard  deviations  and  correla¬ 
tions  were;  G- Intelligence,  V-verbal  aptitude,  P-form  perception,  and 
C-clerical  aptitude.  Champion,  et  al.,  in  1967,  correlated  GATB  scores 
and  GPA  with  MT  (ASCP)  national  registry  exam  results  and  found  the  best 
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predictor  of  score  to  be  GFA.  The  best  combination  consisted  of  GPA 
plus  V-verbal  aptitude.  The  Strong  Vocational  Interest  Blank  (SVIB) 
was  utilized  by  Rausch  and  McClune,  in  1969,  to  test  college  freshman. 

They  found  that  students  who  eventually  completed  the  program  demonstrated 
numerical  and  mechanical  interests  as  well  as  a  preference  for  the  bio¬ 
logical  sciences.  Furthermore,  those  freshman  who  eventually  left  the 
laboratory  program  showed  a  greater  Interest  in  social  service  than  the 
medical  technology  graduates.  In  1970,  Eberfield  and  Love  attempted  to 
describe  the  basic  characteristics  related  to  success  in  medical  techno¬ 
logy.  Utilizing  a  battery  of  psychological  tests  which  included  the 
Bell  Adjustment  Inventory,  Kuder  Perference  Record,  and  the  Selective 
College  Ability  Test  (SCAT) ,  they  found  successful  students  indicated 
a  strong  interest  in  science  activities,  dislike  of  persuasive  activities, 
and  had  a  slightly  higher  mean  value  on  the  aggressive  scale  of  the 
Bell  Adjustment  Inventory  than  the  normal  population.  The  best  single 
predictor  of  performance  in  their  clinical  year  was  past  performance 
[Zufall,  1974]. 

Two  studies  not  addressed  by  Zufall  were  accomplished  by  Duteman 
e£  al .  [1966]  at  the  University  of  Florida.  They  utilized  the  Florida 
Placement  Exam  (FPE) ,  Strong  Vocational  Interest  Blank  (SVIB) ,  Minnesota 
Multiphasic  Personality  Inventory  (MMPI),  Attitudes  Towards  Disabled 
Persons  Test,  and  the  verbal  and  quantitative  portions  of  the  SCAT  to 
distinquish  differences  between  Medical  Technologists  (MT) ,  Occupa¬ 
tional  Therapists  (OT) ,  Physical  Therapists  (PT) ,  Nurses  (N) ,  and  other 
allied  health  workers  (0) ,  at  their  College  of  Health  Related  Pro¬ 
fessions.  The  subjects  consisted  of  206  students  entering  the  Intro- 
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duction  to  the  Health  Professions  course  during  1961,  1962,  and  1963. 

The  scores  of  eventual  graduates  from  each  field  were  used  in  a  discri¬ 
minant  analysis  procedure.  They  found  that  MT  graduates  as  freshman 
scored  higher  on  the  mathematics  subtest  of  the  EPE  and  SCAT  than  PT, 

OT,  and  0.  Factor  analysis  of  the  SVIB  found  laboratory  technology 
loaded  heavily  on  a  separate  factor  than  all  other  health  related  fields 
suggesting  statistical  independence  from  the  other  groups.  Other  pro¬ 
fessions  that  loaded  high  on  this  factor  included;  physicians,  dentists, 
and  mathmetics  and  science  teachers.  MT' s  also  scored  highest  on  the 
factor  of  decreased  personal  interaction  and  low  on  the  personal  inter¬ 
action  factors  (opposite  of  the  other  health  fields  tested) .  Mahalanobis 
distances  for  MT-N,  MT-0,  MT-OT  were  substantially  greater  than  any 
other  conq>arison  distances.  Their  MT  subjects  also  scored  higher  on  a 
masculine  dimension  (related  to  interest  patterns) .  A  career  choice 
questionnaire,  completed  by  all  students  as  freshman,  also  noted  a 
general  lack  of  knowledge  of  the  task  requirements  in  the  different 
health  fields.  They  concluded  that  the  FPE  and  achievement  tests  and 
SVIB  discriminated  among  the  groups,  whereas  the  MMPI,  SCAT,  and  Atti¬ 
tudes  Towards  Disabled  Persons  Test  did  not.  The  MT  group  was  found 
to  have  the  most  accurate  classification  since  they  were  farthest  apart 
from  all  other  groups  in  the  discriminant  analysis. 

Duteman  [1967]  in  another  experiment,  analyzed  differences  between 
the  groups  based  exclusively  on  the  MMPI.  Utilizing  discriminant  analy¬ 
sis  he  was  able  to  discriminate  only  MT's  from  the  other  health  related 
professions  (OT,  PT,  N,  0) .  Best  discrimination  occurred  on  the 


Introversion  Scale  of  the  MMPI. 
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A  review  of  the  use  of  psychological  tests  on  HT's  was  accomplished 
by  Driver  and  Feeley  [1974].  They  concluded  that  MT's  (overall)  are 
inner  directed,  task  oriented,  associate  with  masculine  interests,  and 
have  tradition-oriented  values.  They  also  discussed  the  results  of  a 
study  at  the  University  of  Indiana  that  presented  a  model  for  predicting 
success  in  the  clinical  year  of  their  medical  technology  program.  Vari¬ 
ables  found  to  significantly  correlate  with  success  include  GPA,  age, 
quantitative  chemistry  course  grade,  organic  chemistry  course  grade, 
introductory  microbiology,  and  the  medical  microbiology  lecture  and 
laboratory  course.  Other  variables  that  were  originally  utilized,  but 
found  not  be  significant  in  the  model,  were  three  other  chemistry  courses 
and  six  other  biological  science  courses. 

Personality  characteristics  associated  with  job  satisfaction  were 
investigated  by  French  and  Rezler  [1976] .  They  used  the  Myers-Briggs 
Type  Indicator  (MBTI)  to  identify  personality  characteristics  and  the 
Job  Description  Index  (JDI)  to  measure  job  satisfaction.  The  154 
subjects  studied  were  all  female  and  were  separated  into  functional 
groups  for  comparisons  (educators,  clinical  practice,  and  administra¬ 
tive)  .  With  the  MBTI  they  found  20%  of  the  respondents  of  the  Introvert- 
Sensing-Thinking- Judging  type  (I-S-T-J) .  Their  composite  description 
of  the  I-S-T-J  person  is  one  who  prefers  attention  to  detail,  careful 
exactness,  system,  order,  concrete  tasks,  and  they  make  decisions  based 
on  logic  rather  than  emotions.  Approximately  74%  of  the  clinical  practi¬ 
tioners  are  of  the  S-J  type.  They  note  that  McCalley  found  the  majority 
of  dentists,  physician  assistants,  and  pharmacists  in  this  category. 

A  slight  majority  of  all  groups  fall  along  the  Introvert  scale  with 
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administrators  and  educators  differing  significantly  only  on  the 
Judging-Perceiving  scale.  They  could  make  no  definite  conclusions  about 
personality  interactions  with  job  satisfaction  due  to  the  small  sample 
sizes  within  groups.  However,  they  felt  their  data  suggested  no  inter¬ 
action. 

Interpersonal  values  and  job  satisfaction  was  studied  by  Oliver 
[1978]  using  Gordon's  Survey  of  Interpersonal  Values  (SIV) .  He 
concluded  that: 

1.  MT’s  who  value  independence  and  recognition  tend  to  be 
less  satisfied  with  their  job, 

2.  MT's  who  value  benevolence  and  conformity  tend  to  be  more 
satisfied, 

3.  support  and  benevolence  values  are  more  likely  bench  level 
values, 

4.  MT's  who  value  leadership  are  more  likely  to  be  in  super¬ 
visory  positions. 

Lelken  and  Cunningham  [1980]  examined  the  predictive  ability  of 

the  Allied  Health  Professions  Admissions  Test  (AHPAT)  for  graduation  from 

a  School  of  Allied  Health  Professions  and  reviewed  two  previous  studies 

reporting  conflicting  results  on  the  utility  of  the  AHPAT.  Variables 

that  were  used  other  than  the  AHPAT  composites  were  GPA  and  education 

level.  The  AHPAT  composites  of  reading  comprehension  and  chemistry 

appear  to  offer  increases  in  predictability  after  inclusion  of  GPA 

and  education  level  for  MTs.  Of  all  programs  studied  (cardiorespiratory 

science,  medical  technology,  physician’s  assistants,  and  physical 

therapy),  the  AHPAT  performed  the  poorest  for  the  MT  subjects.  The 
2 

highest  R  was  .22  for  MTs,  as  opposed  to  values  of  .59  (PA),  .48  (PT) , 
and  .47  (CRS)  for  the  others. 
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Recently,  Rifkin  et  al.  [1981],  at  the  University  of  Illinois, 
analyzed  the  factors  presently  utilized  in  their  medical  technology 
selection  procedures.  Academic  factors  consisted  of  sciences  GPA,  non¬ 
science  GPA,  a  manual  dexterity  test,  and  a  weighted  sum  of  the  science 
and  non-science  GPA.  Non-academic  factors  included  knowledge  of  occupa¬ 
tion,  career  goals,  interview,  written  ability,  relationships  with 
others,  and  problem  solving  skills.  Their  results,  based  on  52 
graduates,  were  that  the  academic  factors  predicted  the  academic  success 
criterion  with  validity  coefficients  of  .61  with  program  GPA,  .38  with 
their  comprehensive  exam,  and  .38  with  the  MT  (ASCP)  national  registry 
exam.  The  non-academic  factors  correlated  the  highest  witih  the  criterion 
of  hematology  clinical  success  (.47),  general  clinical  experience  (.37), 
and  microbiology  clinical  success  (.30). 

Two  major  limitations  noted  in  almost  all  the  studies  presented 
are  small  sample  sizes  and  the  lack  of  cross-validation.  The  latter 
problem  most  likely  a  function  of  the  first.  This  problem  will  most 
likely  continue  in  light  of  the  limited  class  sizes  in  the  medical 
laboratory  programs.  However,  this  fact  may  not  be  so  damaging,  due  to 
the  consistent  patterns  that  appear  to  emerge  from  the  studies.  General 
findings  that  appear  to  correlate  highly  with  academic  success  are 
intelligence,  numerical  and  verbal  aptitudes,  and  high  school  grade 
point  averages.  Clinical  success  in  the  laboratory  appears  to  be 
related  to  non-academic  factors  such  as  mechanical,  perceptual,  or 
spatial  aptitudes.  Job  satisfaction  and  attrition  (independently  or 
interrelated)  appear  to  be  related  to  interpersonal  values.  Interests, 

i 

and/or  personality.  Also,  evidence  was  presented  that  suggests  that  j 

i 

kJ 


medical  laboratory  workers  may  require  different  aptitude  levels,  inter¬ 
personal  styles,  and  interests  than  other  allied  health  workers  to  be 
successful . 


METHOD 


Subjects 

Data  were  available  on  essentially  all  enlisted  personnel  entering 
and  completing  courses  J3ABR90430  and  J5A2090450,  Medical  Laboratory 
Specialist  (MLS)  for  two  years  prior  to  the  1981  fiscal  year  (FY) . 
Although  class  rosters  were  available  containing  data  prior  to  this 
date,  substantiating  records  (ATC  Form  156,  Student  Record  of  Training) 
for  each  student  were  maintained  by  administrative  personnel  for  only 
the  preceding  two  years.  The  original  sample  consisted  of  the  828 
military  personnel  who  entered  course  J3AER90430  between  10  August  1978 
to  15  December  1980.  Students  eliminated  from  the  program  for  non- 
academic  reasons  (i.e.,  medical,  administrative,  predjudicial  conduct, 
nonadaptability  to  military  life,  etc.)  were  not  used  in  the  data 
analysis  which  brough  the  final  sample  to  784  individuals. 

Measures 

Cognitive  aptitude  measures  were  obtained  from  the  Armed  Services 
Vocational  Aptitude  Battery  (ASVAB)  Form  6/7  which  produce  scores  for 
cognitive  aptitudes  based  on  composites  obtained  from  nine  subtests, 
and  a  general  intelligence  score  based  on  a  composite  of  three  subtests 
known  as  the  Air  Force  Qualifying  Test  (AFQT)  [Jensen  et  al.,  1976]. 
Appendix  A  contains  a  listing  and  explanation  of  the  subtests  making 
up  each  composite.  A  general  mathematics  ability  test  (MPT)  is 


25 


administered  to  students  after  assignment  to  MLS  technical  training,  but 
before  the  start  of  classes  to  help  identify  students  possibly  requiring 
increased  special  assistance. 

The  predictor  variables  utilized  in  this  study  were: 

1.  age  at  enlistment  date  (AGE) 

2.  years  of  education  completed  (YED) ,  where  12  signifies  high 
school  completion,  13,  one  year  of  college,  14,  two  years  of 
college,  etc. 

3.  general  intelligence,  as  measured  by  the  AFQT 

4.  mechanical  aptitude  (MI) 

5.  administrative  aptitude  (AI) 

6.  general  aptitude  (GI) 

7.  electrical  aptitude  (EL) ,  as  measured  by  the  ASVAB 

8.  general  mathematics  ability,  as  measured  by  the  MPT 

9.  class  shift  (Class  A,  B,  C) . 

The  first  three  variables,  education,  intelligence,  and  age,  have  shown 
predictive  value  consistently  in  military  studies  [Klieger  et  al . , 

1961;  Plag,  1962;  Lecznar,  1964;  Goodstadt  and  Glickman,  1975;  Hoiberg 
and  Pugh,  1978;  Sands,  1978],  Cognitive  aptitudes  are  presently  used  as 
placement  tools  in  the  USAF  and  have  been  found  to  be  related  to 
attrition  in  technical  training  [McReynolds,  1963;  Leisey  and  Guinn, 
1977;  Mathews  and  Jensen,  1977;  Frederico,  and  Landis,  1979].  Roark 
[1981]  found  mathematics  ability,  as  measured  by  the  MPT  and  Tests  of 
Basic  Education  (TABE) ,  to  be  related  to  failure  in  the  MLS  technical 
training  chemistry  block.  In  addition,  class  shift  was  included  due 
to  an  impression  by  a  school  administrator  that  the  evening  shift  had 
a  failure  rate  noticeably  less  than  the  other  two  daytime  shifts. 
Variable  descriptions  are  given  in  Table  1. 


Criterion 


A  dicotomous  criterion  of  Graduates/Failures  was  used  in  the  study. 
Graduates  were  considered  to  be  those  students  who  completed  both 
Phase  I  and  Phase  II  training  successfully.  Failues  were  those  students 
who  were  eliminated  from  either  Phase  I  or  Phase  II  training  due  to 
academic  deficiency.  Based  on  these  definitions,  666  students  were 
catagorized  into  Group  1  (Graduates)  and  118  into  Group  2  (Failures) . 


Analyses 


The  analyses  were  carried  out  in  three  parts.  In  the  first  part, 
significance  tests  for  the  differences  between  the  means  of  all  variables 
were  computed  for  Graduates,  Phase  I  failures,  and  Phase  II  failures,  to 
determine  if  Graduates  differed  from  Failues  and  to  determine  whether 
Phase  I  Failures  differed  from  Phase  II  Failures.  This  was  accomplished 
by  performing  a  one-way  analysis  of  variance  for  each  variable.  If  the 
multisample  hypothesis  of  equal  group  means  was  rejected,  then  a 
multiple  comparison  test  of  group  means  was  used  to  assess  specific 
group  mean  differences.  Probability  of  Type  I  error  was  held  at  the  .05 
level  for  group  mean  differences  and  for  individual  pairs  of  means  in 
multiple  comparisons.  Also,  point  biserial  product  moment  correlations 
were  obtained  for  all  continuous  variables  with  the  dicotomous  Graduate/ 
Failure  criterion  to  evaluate  variable  validity  to  graduation.  Pearson 
product  moment  correlations  were  computed  between  variables  to  determine 
the  degree  of  collinearity  between  them,  and  first-order  partial  correla¬ 
tions  were  computed  due  to  the  reported  high  correlations  between  the 
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TABLE  1.  LIST  OF  VARIABLES 


Variable 

Number 

Variable  Name 

Type 

Variable 

Predictors 

1 

Class  shift  A 

Categorical 

2 

Class  shift  B 

Categorical 

3 

Class  shift  C 

Categorical 

4 

Age  at  enlistment 

Continuous 

5 

Years  of  education 

Continuous 

6 

AFQT  score 

Continuous 

7 

Mathematics  Pretest 
score 

Continuous 

8 

Mechanical  Aptitude 
score 

Continuous 

9 

Administrative 
Aptitude  score 

Continuous 

10 

General  Aptitude 
score 

Continuous 

11 

Electrical  Aptitude 
score 

Continuous 

Criterion 

1 

Graduate 

Discrete 

2 

Failure 

Discrete 

Description 


Indicates  first  dayshift 
class 

Indicates  second  day- 
shift  cl<:«»3 

Indicates  night  class 

Age  of  student  trainee 
at  time  of  enlistment 

Number  of  years  of  edu¬ 
cation  completed 

Percentile  score  derived 
from  the  AFQT/ASVAB;  a 
measure  of  general  mental 
ability 

Course-developed  general 
mathematics  test 

Percentile  score  derived 
from  ASVAB  subtests 

Percentile  score  derived 
from  ASVAB  subtests 

Percentile  score  derived 
from  ASVAB  subtests 

Percentile  score  derived 
for  ASVAB  subtests 


Student  vho  successfully 
completed  course 
J3ABR 90430  and 
J5A2090450 

Student  who  was  academi¬ 
cally  dismissed  from 
either  course  J3AER90430 
or  J5A2090450 


aptitude  composites  [Vanderploeg  and  Mueller,  1978;  Cronbach,  1978]. 

The  amount  of  reduction  in  the  validity  correlations,  when  the  Influence 
of  another  highly  correlated  variable  is  partialed  out,  allows  one  to 
evaluate  the  significance  of  information  in  the  non-constant  variables 
not  associated  with  the  partialed  variable  [Guilford  and  Fruchter, 

1978].  In  this  way,  an  indirect  approach  is  taken  to  evaluate  specific 
subtest  validity  to  the  criterion. 

In  the  second  part,  a  discriminant  analysis  was  performed  on  the 
two-group  criterion.  An  explorative  approach  was  taken  in  the  develop¬ 
ment  of  the  linear  discriminant  function.  As  such,  all  variables  were 
included  in  the  model.  For  classification  purposes,  two  classifica¬ 
tion  rules  were  initially  proposed.  In  the  first,  it  was  assumed  that 
students  had  an  equal  probability  of  graduation  or  failure.  In  the 
second,  a  Baysian  adjustment  of  the  probability  was  made  to  the  a  priori 
probabilities  of  group  membership  [Cooley  and  Lohnes,  1971;  Overall  and 
Klett,  1972;  Lachenbruch,  1975;  Hull  and  Nie,  1979].  Due  to  peculi¬ 
arities  in  the  data,  two  alternative  classification  rules,  graphic  and 
quadratic  methods,  are  also  presented.  Furthermore,  an  examination  of 
the  standardized  discriminant  scores  was  accomplished  to  explore  the 
group  overlaps  and  distributions. 

In  the  third  part,  the  resulting  classification  rules  were  applied 
to  an  independent  sample  that  was  held  out  of  the  sample  used  to 
develop  the  linear  discriminant  function.  In  this  way,  an  estimate  of 
the  expected  misclasslfication  rate  can  be  determined  [Eisenbels  and 
Avery,  1972;  Lachenbruch,  1975]. 


RESULTS 


Evaluation  of  Means 

The  first  objective  of  this  study  was  to  explore  the  significance 
of  the  variables  selected  in  predicting  graduation  or  failure  from  the 
MLS  course.  The  initial  approach  was  to  assess  differences  (Table  2) 
between  graduates  and  failures  based  on  results  achieved  on  aptitude 
and  ability  tests,  age,  and  education  level.  A  pairwise  deletion  pro¬ 
cedure  was  used  to  incorporate  as  much  of  the  data  as  possible.  Under 
pairwise  deletion,  a  case  is  omitted  from  the  computation  only  if  the 
variable  being  considered  is  missing.  A  case  will  therefore  be 
included  in  all  computations  for  which  it  has  complete  data.  Mean  dif¬ 
ferences  between  Graduates,  Phase  I  and  Phase  II  Failures  were  tested 
by  a  one-way  analysis  of  variance  and,  if  significant  at  the  .05  level, 
were  compared  for  specific  differences  using  the  Least-Significant  Dif¬ 
ference  (LSD)  procedure  (Steel  and  Torrie,  1960).  By  this  method, 
significant  differences  between  Graduates  and  Phase  I  Failures  were  found 
on  seven  of  the  eight  variables  compared  (Table  3) .  Phase  I  and  Phase  II 
Failures  differed  significantly  only  in  mechanical  aptitude  (MI).  When 
Phase  I  and  Phase  II  Failures  are  combined  (Table  4) ,  significant  dif¬ 
ferences,  except  for  age  at  enlistment,  remained  between  the  two  groups. 
The  two  group  differences  were  tested  for  significance  using  Student's 
t  statistic  [Zar,  1974].  Class  codes  were  subjected  to  a  chi-square 


TABLE  3.  DIFFERENCES  BETWEEN  ALL  PAIRS  OF  MEANS 


Variable 

Means/ Group 

Differences* 

18.67 

Phase  II  Failures 

a 

AGE 

20.33 

Phase  I  Failure 

ab 

20.69 

Graduates 

b 

12.33 

Phase  II  Failure 

ab 

YED 

12.55 

Phase  I  Failure 

b 

12.82 

Graduates 

a 

65.64 

Phase  I  Failure 

a 

MPT 

70.83 

Phase  II  Failures 

a 

85.78 

Graduates 

b 

58.45 

Phase  I  Failure 

a 

APQT 

58.83 

Phase  II  Failure 

a 

70.23 

Graduates 

b 

38.33 

Phase  I  Failure 

a 

MI 

54.08 

Graduates 

b 

54.58 

Phase  II  Failure 

b 

62.92 

Phase  II  Failure 

a 

AI 

67.96 

Phase  I  Failure 

a 

75.08 

Graduates 

b 

71.95 

Phase  I  Failure 

a 

GI 

77.50 

Phase  II  Failure 

ab 

80.62 

Graduates 

b 

53.54 

Phase  I  Failure 

a 

EL 

56.25 

Phase  II  Failure 

a 

70.91 

Graduates 

b 

♦Group  means  not  having  a  letter  In  common  differ  significantly  at 
P*.05  as  judged  by  the  Least  Significant  Difference  Method. 


j 
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TABLE  4.  MEANS,  STANDARD  DEVIATIONS,  AND  SIGNIFICANCE 
TESTING  FOR  DIFFERENCES  BETWEEN  GRADUATES  AND 
FAILURES  (PHASE  I  AND  PHASE  II  COMBINED) 


*p  <  .01 


***p  <  .001 


analysis  and  the  hypothesis  of  independence  was  accepted  at  the  .05 
2 

level  (x  *.673  with  2  degrees  of  freedom  (df)). 

In  general.  Graduates  have  a  slightly  higher  level  of  education, 
and  score  higher  on  tests  of  intelligence,  numerical  ability,  and 
aptitudes  than  Failures.  Failures  in  Phase  II  appear  to  be  more  like 
Failures  in  Phase  I  than  they  are  to  Graduates,  but  on  the  average  are 
younger  than  both  Graduates  and  Phase  I  Failures.  The  largest  differences 
between  the  two  groups  was  on  the  MPT,  EL,  and  AFQT,  with  the  Graduates 
scoring  significantly  higher  than  the  Failures.  Class  shift  is  not 
found  to  be  related  to  any  group  inparticular. 

Validity  Correlations 

Pearson  product  moment  correlations  (pmc)  were  computed  between 
all  predictor  variables  to  evaluate  their  degree  of  collinearity.  A 
symmetric  matrix  of  these  correlations  is  shown  in  Table  5.  It  can 
be  seen  that  all  correlations  between  test  scores  are  positive  and 
range  from  .16  to  .80,  demonstrating  moderate  degrees  of  collinearity. 

Each  correlation  was  tested  for  significance  greater  than  zero  by  means 
of  Fisher's  t  ratio  [Guilford  and  Fruchter,  1978].  In  all  cases,  the 
correlations  between  test  scores  were  significant  at  the  .001  level. 

Point  biserial  pmc's  were  computed  to  assess  the  relationship  of 
each  variable  to  the  criterion  of  graduation.  The  higher  the  correla¬ 
tion,  the  greater  the  linear  relationship  between  the  variable  and  the 
criterion.  Thus,  for  high  positive  correlations,  the  higher  the  test 
score,  the  greater  the  probability  of  being  a  graduate  and  the  greater 


TABLE  5.  CORRELATIONS  BETWEEN  PREDICTOR  VARIABLES  (n-641) 


CA 

CB 

AGE 

YED 

MPT 

AFQT 

MI 

AI 

GI 

EL 

CA 

1.0 

1.0 

CB 

-.94* 

AGE 

.01 

o 

o 

YED 

o 

o 

• 

i 

o 

o 

.57* 

ESI 

MPT 

• 

o 

00 

-.07 

i 

• 

o 

Ui 

00 

o 

• 

1.0 

wm 

AFQT 

.06 

-.05 

.12 

.11 

KB 

MI 

mm 

1 

• 

o 

.05 

R9 

.36* 

.58* 

1.0 

AI 

.08 

BPS 

HB9 

R5 

m 

.32* 

.16* 

RH 

GI 

.06 

• 

o 

00 

m 

.46* 

IS99 

.48* 

■30 

UMI 

EL 

.06 

-.05 

.01 

.04 

.51* 

.77* 

.69* 

.18* 

.58* 

*p  <  .001,  correlation  not  equal  to  zero. 


that  test's  validity  to  the  criterion.  The  aptitude  test  composites  for 
ASVAB  Form  6/7  are: 

1.  AFQT  (WK  +  AR  +  SP) 

A.  Word  Knowledge  (WK) 

b.  Arithmetic  Reasoning  (AR) 

c.  Spatial  Perception  (SP) 

2.  Mechanical  (Ml)  (AI  +  MC  +  SI) 

a.  Automotive  Information  (AI) 

b.  Mechanical  Comprehension  (MC) 

c.  Shop  Information  (SI) 

3.  Administrative  (AI)  (WK  +  AD  +  NO) 

a.  Word  Knowledge 

b.  Attention  to  Detail  (AD) 

c.  Numerical  Operations  (NO) 

4.  General  (GI)  (WK  +  AR) 

a.  Word  Knowledge 

b.  Arithmetic  Reasoning 


A 


5.  Electronics  (EL)  (AR  +  SP  +  El) 

a.  Arithmetic  Reasoning 

b.  Spatial  Perception 

c.  Electronics  Information  (El)  [DOD,  1976]. 

Because  of  the  moderate  overlap  between  subtests  within  the  composites , 
a  partial  correlation  procedure  was  accomplished  to  partial  out  the 
linear  effects  of  a  composite.  Then  the  correlation  to  graduation  of 
the  remaining  variables  was  recalculated  by 

rij.k 

where  k  is  the  control  variable,  i  and  j  are  the  independent  and  depen¬ 
dent  variables,  and  r  is  the  zero-order  pmc  [Guilford  and  Fruchter, 
1978].  The  results  of  the  zero-order  and  first-order  partial  correla¬ 
tions  are  shown  in  Table  6.  It  can  be  seen  (Table  6)  that  all  variables 
have  a  positive  correlation  with  graduation.  The  MPT,  AFQT,  EL,  and  GI 
appear  to  demonstrate  the  largest  validity  to  graduation.  Significant 
reductions  in  correlations  occur  when  certain  tests  are  held  constant. 
When  the  information  contained  in  the  MPT  is  held  constant,  the  aptitude 
composites  AI,  GI,  and  AFQT  are  reduced  to  less  than  .1.  When  EL  is 
held  constant,  the  AFQT,  AI,and  MI  are  reduced  to  less  than  .1.  The 
partialing  of  AFQT  reduces  MI,  AI,  and  GI,  but  is  less  effective  than 
the  MPT  in  reducing  the  EL.  The  GI  reduces  the  AI  significantly,  but 
is  less  effective  than  the  EL,  AFQT,  or  MPT.  The  correlation  of  the  GI 
reduces  to  .1  or  less  when  the  arithmetic  reasoning  subtest  is  partialed 
out  by  the  AFQT  or  EL,  indicating  that  the  word  knowledge  subtest  may  be 
constant  in  the  group.  This  would  not  be  inconsistent  with  preselection 
based  on  the  GI.  Inferring  from  correlation  reductions  and  variable 
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TABLE  6.  POINT  BISERIAL  CORRELATIONS  AND  PARTIAL 
CORRELATIONS  TO  GRADUATION 


Point  Biserial  (n*638) 


H- 

8- 

a> 

CD 

AGE 

YED 

MPT 

AFQT 

MI 

AI 

GI 

EL 

.04 

.08 

.45* 

,28* 

.25* 

.15* 

.27* 

.33* 

AGE 

— 

.06 

.45* 

.28* 

1 

.26* 

.33* 

CD 

rt 

YED 

-.00 

— 

.44* 

.28* 

Kill 

H89 

.26* 

.32* 

O 

MPT 

.07 

.05 

_ 

.08 

.10 

-.01 

.08 

.13* 

a  o. 

II  fl> 
on  n 

AFQT 

.05 

.37* 

— 

.11 

.07 

.07 

.17* 

-p> 

MI 

fell 

.07 

.39* 

.18* 

— 

.12 

.17* 

.22* 

rt 

H* 

AI 

B9 

.05 

.42* 

.25* 

.23* 

— 

.23* 

.31* 

M 

CD 

GI 

.02 

.06 

.38* 

.12* 

.14* 

.05 

— 

.22* 

EL 

.04 

.07 

.34* 

.05 

.03 

.10 

.10 

— 

*p  <  .001,  correlation  greater  than  zero. 


significance  to  graduation,  it  appears  that  the  most  powerful  predictor 
is  the  MPT  (lowest  validity:  .34).  Also,  the  EL  or  AFQT  are  the  only 
other  variables  to  offer  any  appreciable  validity.  Since  the  AFQT  is 
reduced  more  by  the  EL  than  vice  versa,  it  appears  that  the  EL  may 
offer  slightly  more  predictive  power  than  the  AFQT. 


Discriminant  Model  Development 

The  second  objective  of  this  study  was  to  examine  the  utility  of  a 
discriminant  model  for  the  prediction  of  MLS  Graduates  and  Failures.  The 
discriminant  analysis  procedure  utilized  for  this  study  was  computed 
using  the  Statistical  Package  for  the  Social  Sciences,  (SPSS  Level  8) 
[Nie  et  al. ,  1975;  Hull  and  Nie,  1979].  The  purposes  of  a  discriminant 


analysis  are:  (1)  to  test  for  mean  group  differences  and  to  describe 
the  overlaps  between  the  groups,  and  (2)  to  develop  classification  ‘ 

t . 

schemes  based  on  a  set  of  p  variables  in  order  to  assign  previously 
unclassified  observations  into  appropriate  groups  [Eisenbeis  and  Avery, 
1972].  Thus,  for  exploratory  purposes,  it  has  both  descriptive  and 
predictive  utility.  In  the  two  group  case,  the  discriminant  analysis 
attempts  to  form  a  linear  combination  of  the  p  variables  of  the  form 

Yi  "  “1*11  +  a2z2i  + . +  apzpi 

where  i  *  l,2,.,.,n. ,  Y,  is  the  discriminant  score,  the  a's  are  the 
weighting  coefficients,  and  the  z's  are  the  standardized  values  of  the 
p  discriminating  variables  used  in  the  analysis.  The  problem  becomes 
the  determination  of  optimal  weighting  coefficients  such  that  the  dis¬ 
tance  between  the  mean  scores  for  the  two  groups  is  maximized  relative 
to  the  variance  within  the  groups.  The  underlying  assumptions  for  this 
procedure  are  that  the  two  groups  being  studied  are;  (1)  discrete  and 
identified,  (2)  each  observation  in  each  group  can  be  described  by  a 
set  of  measurements  on  p  variables,  and  (3)  the  variables  have  a  multi¬ 
variate  normal  distribution  in  each  population  [Eisenbeis  and  Avery, 
1972].  A  brief  review  of  the  computational  steps  required  for  deriving 
the  linear  discriminant  function  (LDF)  for  two  groups  is  given  in 
Appendix  B.  More  complex  mathematical  treatments  for  the  two  group  and 
the  n  group  cases  can  be  found  in  various  texts  [Tatsuoka,  1971;  Cooley 
and  Lohnes,  1971;  Lachenbruch,  1975]. 
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Sub sample  Selection 

The  total  sample  of  784  subjects  was  randomly  split  Into  two  sub¬ 
samples.  This  was  accomplished  by  generating  a  random  sample  of  uni¬ 
formly  distributed  numbers  from  0  to  1.66  and  truncating  the  decimal 
portion.  By  this  method,  approximately  60%  of  the  total  sample  would 
be  coded  zero  and  assigned  to  subsample  1  and  the  other  40%  coded  one 
and  assigned  to  subsample  2  [Hull  and  Nie,  1979].  The  first  subsample 
was  used  to  develop  the  discriminant  function,  while  the  second  was 
used  for  cross-validation.  Those  subjects  who  had  at  least  one  missing 
discriminating  variable  were  excluded  from  model  development,  but  were 
used  in  classification.  In  case  of  missing  values  during  classification, 
the  group  mean  score  for  the  respective  group  and  variable  was  used 
to  replace  the  missing  variable  value  [Chan  and  Dunn,  1972].  The  break¬ 
down  of  the  total  sample  is  as  follows: 

784  cases  used  for  the  total  analysis 

474  cases  selected  for  subsample  1  (SSI) 

86  cases  were  excluded  from  SSI  due  to  missing  values 
386  were  used  for  model  development 

310  cases  were  selected  for  subsample  2. 

Procedure 

A  stepwise  procedure  for  variable  inclusion  into  the  model  was 
accomplished  based  on  the  criterion  of  reduction  of  Wilk's  lambda.  In 
general,  SPSSWILK'S  attempts  to  obtain  a  smaller  overall  Wilk's  lambda 
than  was  obtained  at  an  earlier  step  which  used  the  same  number  of  vari¬ 
ables.  Computational  formulation  and  procedural  steps  as  used  in  the 
SPSSWILK'S  selection  method  is  given  by  Gondek  [1981].  A  corresponding 
F  statistic  [Rao,  1965]  is  used  to  test  the  significance  of  the  decrease 
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in  Wilk's  lambda  resulting  from  the  addition  of  some  new  variable.  For 
this  study,  the  variable  tolerance  level  was  set  at  .001  (default), 
minimum  F-to-enter  0.0,  and  F-to-remove  0.0.  The  null  F  values  were 
used  so  that  all  variables  would  be  entered  into  the  analysis  in  a 
stepwise  manner.  Table  5  shows  the  general  descriptive  statistics  for 
the  subsample  used  in  development  of  the  LDF. 

It  can  be  seen  that  the  means  and  standard  deviations  of  the 
development  subsample,  shown  in  Table  7,  compare  favorably  with  those 
calculated  from  the  total  sample. 


TABLE  7.  GROUP  MEANS  AND  STANDARD  DEVIATIONS  OF  THE 

VARIABLES  USED  IN  THE  SUBSAMPLE  FOR  LDF  DEVELOPMENT 


*  1 

i  Variables 

Graduates 

Failures  ] 

M 

S.D. 

M 

S.D. 

Class  A 

.52 

.50 

.47 

.50 

Class  B 

.44 

.50 

.52 

.50 

AGE 

20.52 

2.79 

19.92 

2.32 

YED 

12.80 

1.19 

12.48 

.91 

MPT 

85.37 

13.19 

67.09 

19.05 

!  AFQT 

70.79 

14.93 

57.94 

9.10 

1  111 

55.79 

25.24 

41.09 

18.55 

1  AI 

75.14 

16.92 

65.0 

18.49 

GI 

81.51 

11.68 

72.50 

10.20 

EL 

71.58 

18.74 

54.06 

18.49 

Individual  group  covariance  matrices  were  computed  and  tested  for 
equality  utilizing  Box's  M  statistic  and  its  associated  approximate  F 
test  [Cooley  and  Lohnes,  1971].  The  matrices  were  found  to  be  signifi¬ 
cantly  different  at  a  confidence  level  less  than  .001  (Box's  M  m  136.65, 
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F  *  2.34,  with  55  and  42033  df).  Various  researchers  have  noted  that 
the  quadratic  rule  is  the  appropriate  one  to  use  in  cases  of  differing 
covariance  matrices;  however,  the  improvement  in  classification  varies 
from  case  to  case  [Eisenbeis  and  Avery,  1972;  Lachenbruch,  1975].  Thus, 
a  quadratic  discriminant  function  and  classification  rule  was  also 
developed.  Computer  output  for  this  analysis  can  be  found  in  Appendix  F. 

The  following  linear  standardized  discriminant  function  coefficients 
were  developed: 


Class  shift  A  (VI) . -.36386 

Class  shift  B  (V2) . -.44812 

Age  at  enlistment  (V3) . 18136 

Years  of  educatin  (V4) . 08866 

AFQT  (V5) . 10871 

MPT  (V6) . 71745 

MI  (V7) . -.06417 

AI  (V8) . 09331 

GI  (V9) . 03553 

EL  (10) . 27587 


Table  8  shows  a  comparison  of  three  methods  for  determining  the  amount 
of  contribution  of  each  variable  to  discrimination  between  the  two  groups. 
The  univariate  F  test  approximates  the  relative  discriminatory  power 
of  each  variable  by  comparing  the  significance  levels  of  the  univariate 
analysis  of  variance  F  test  for  each  variable  to  the  criterion  [Eisenbeis 
and  Avery,  1972].  However,  this  procedure  for  choosing  variables  to  be 
included  in  the  model  fails  to  consider  the  correlations  between  the 
variables  [Cochran,  1964],  which  are  moderate  for  this  data.  Using  the 
standardized  discriminant  coefficients  from  a  full  variable  model,  the 
discriminatory  power  of  individual  variables  can  be  evaluated  in  a  marine r 
similar  to  the  method  of  beta  weights  in  regression  analysis  [Goldberger, 
1964].  However,  for  highly  correlated  variables  the  coefficients  will  be 


TABLE  8.  METHODS  TO  DETERMINE  SIGNIFICANCE  OF  VARIABLES  IN  DISCRIMINATION 
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unstable  and  hard  to  Interpret  [Morrison,  1969].  The  importance  of 
class  code  in  the  standardized  discriminant  coefficients  might  then  be 
suspect  due  to  their  high  correlation  and  their  lack  of  importance  as 
predictors  of  graduation  in  earlier  results.  The  stepwise  procedure 
utilized  for  variable  inclusion  (SPSSWILK'S)  is  the  Conditional  Test 
that  is  based  on  variables  already  Included  in  previous  steps.  Analysis 
of  the  reduction  in  Wilk's  lambda,  noted  in  Table  8,  show  that  discrimi¬ 
nation  after  the  inclusion  of  MPT,  AFQT,  AGE,  and  EL  is  negligible.  Also, 
the  F-to-enter  after  the  inclusion  of  EL  is  reduced  to  1.0  which  is  the 
SPSS  DISCRIMINANT  default  minimum  F-to-enter.  In  referring  to  packaged 
discriminant  programs,  Gondek  [1981]  has  recommended  that  the  best  pro¬ 
cedure  for  variable  inclusion  when  using  a  stepwise  procedure  is  to  use 
the  threshold  default  values  supplied  by  the  package,  since  no  simple 
rules  exist  for  determining  entry  or  removal  thresholds  for  partial  F's, 
tolerance  statistics,  or  any  of  the  other  statistical  criteria  used  in 
the  stepping  procedures.  Thus,  the  only  variables  that  would  be  entered 
into  the  model  under  default  thresholds  would  be  MPT,  AFQT,  AGE,  and 
EL. 

It  is  apparent  that,  by  any  method,  discrimination  is  dominated  by 
the  MPT.  Either  AFQT  or  EL  appear  to  offer  the  second  best  discrimi¬ 
natory  power  depending  on  which  is  entered  into  the  equation  first. 
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Distributions  of  the  Discriminant  Scores 

Discriminant  scores  were  derived  using  the  standardized  discriminant 
coefficients  and  the  subject  scores  which  have  been  converted  to  standard 
form  (z-scores).  As  such,  the  discriminant  scores  produced  are  in 
standard  form.  So,  over  all  cases  in  the  analysis,  the  scores  from  the 
discriminant  function  will  have  a  mean  of  zero  and  a  standard  deviation 
of  one.  Any  single  score  then  represents  the  number  of  standard  devia¬ 
tions  that  the  case  is  away  from  the  mean  for  all  cases.  Group  means 
can  be  found  by  averaging  the  scores  for  the  cases  within  each  group. 

The  SPSS  generated  frequency  histogram  for  Graduates  (Group  1)  and 
Failures  (Group  2)  is  shown  in  Figure  1  and  Figure  2,  respectively. 

Under  the  assumption  of  multivariate  normal  distributions  for  the  dis¬ 
criminating  variables  in  the  linear  function,  the  reduced  discriminant 
scores  should  also  be  normally  distributed.  An  examination  of  the 
histogram  for  Graduates  demonstrates  a  slight  negative  skew.  The  mean 
for  this  distribution  then  is  pulled  toward  the  skewed  end  [Guilford 
and  Fruchter,  1978].  In  the  case  of  the  Failures,  shown  in  Figure  2, 
the  distribution  takes  an  apparent  bimodal  shape.  A  scaled  drawing  of 
the  group  dispersions  and  mean  positions  is  shown  in  Figure  3.  The 
plots  show  that  the  assumption  of  normality  in  the  group  populations 
does  not  hold  and  that  a  moderate  degree  of  overlap  exists.  The  nega¬ 
tive  implications  of  nonnormality  would  most  likely  be  apparent  in  the 
classification  results  since  the  probabilities  of  group  membership  are 
based  on  the  distribution  of  the  normal  density  function. 


FIGURE  1 
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Classification 


The  third  part  of  the  analyses  was  to  produce  classification  tables 
based  on  the  developed  classification  equations.  Classification  pro¬ 
cedures,  as  given  by  SPSS  DISCRIMINANT,  utilize  the  pooled  within-groups 
covariance  matrix  and  the  centroids  for  the  discriminating  variables. 
Jennrich  [1977]  and  Gondek  [1981]  discuss  the  classification  derivations 
and  a  brief  review  of  their  discussion  is  given  in  Appendix  C.  One 
could  conclude  from  the  knowledge  of  unequal  dispersion  matrices  and 
the  group  mean  bias,  imposed  by  nonnormality  of  the  group  distributions, 
that  it  may  not  be  optimal  to  classify  subjects  utilizing  the  SPSS  pro¬ 
duced  classification  equations.  Overall  and  Klett  [1972]  have  recom¬ 
mended  classification  by  graphic  inspection  in  such  cases,  since  no 
theoretical  assumptions  are  necessary.  The  graphic  procedure  requires 
the  selection  of  an  appropriate  cutting  score  Y£  and  classifies  indi¬ 
viduals  from  the  discriminant  reduced  space.  The  discriminant  reduced 
space  refers  to  the  univariate  distributions  of  the  standardized  dis¬ 
criminant  scores,  as  opposed  to  the  test-space  utilized  in  the  packaged 
classification  functions.  Those  scores  greater  than  the  cutting  point 
Y£  are  classified  into  one  group  and  all  others  into  the  other  group. 

The  choice  of  Y£  will  depend  on  the  acceptable  level  of  mlsclassifica- 
tion  for  the  two  groups.  A  graphic  classification  was  accomplished  from 
the  SPSS  produced  histograms  to  assess  whether  this  method  would  offer 
improvement  in  classification. 

Under  equal  a  priori  assumptions,  an  Individual  entering  the 
training  program  has  an  equal  chance  of  failing  or  graduating.  However, 


since  knowledge  of  the  £  priori  odds  of  graduating  or  failing  is  known, 
a  Baysian  adjustment  can  be  made  to  the  classification  equations  so  that 
this  knowledge  can  be  taken  into  account.  The  SPSS  procedure  is  to  add 
the  natural  log  of  the  prior  probabilities  to  the  classification  equa¬ 
tion  constants  [Hull  and  Hie,  1979].  Morrison  [1964]  offers  a  method 
for  evaluating  the  classification  tables  produced  ("confusion  matrix") 
in  light  of  the  chance  probability  of  correctly  classifying  an  individual 
when  the  population  odds  of  membership  are  known.  The  probability  of 
an  individual  being  classified  correctly  by  chance  is 

P (Correct)  -  P (Correct/Classified  Group  I)  *  P (Classified  Group  I) 

+  P(Correct/Classified  Group  II) 

P (Correct)  *  p  ’  “  +  (1-p) (l-“) 

where  p  -  true  proportion  of  Group  I  and  «  *  proportion  classified  as 
Group  I.  If  one  is  forced  to  classify  to  the  proportions  of  each  group 
in  the  population,  then  the  chance  criterion  is 

C  m  CC2  +  (l-cc)2. 
pro. 

A  maximum  chance  classification  based  on  classifying  everyone  into  the 

larger  group  is  given  by 

Cmt  -  («,  l-«) ,  whichever  is  greatest. 

For  this  data; 

C  -  74.4% 
pro. 


Table  9  compares  the  linear  equal  and  unequal  a  priori  results.  Table  10 
presents  the  quadratic  classification  results  and  Table  11  is  the 


results  of  the  graphic  procedure,  where  the  cutting  point  Y£  was  chosen 


such  that  the  misclasslf ications  for  each  group  are  held  to  a  minimum 
(Y  *  -1.6).  Table  12  compares  all  the  classification  results  in  light 
of  Morrison' s  chance  criterions. 


T 


TABLE  10.  QUADRATIC  CLASSIFICATION  RESULTS 


1EDICTED 


Group 

N 

Graduate 

Graduate 

398 

337 

Failure 

76 

29 

Graduate 

268 

215 

Failure 

42 

18 

« 

Failure 


6 


TABLE  11.  GRAPHIC  CLASSIFICATION  RESULTS* 


Actual 

Group 


Graduate 


PREDICTED 


Graduate 


646 


Failure 


2 


Failure 


♦cutting  score,  Y£  ”  -1.6 


It  can  be  seen  in  Table  12  that  all  classification  rules  exceed  that 
which  would  be  expected  by  chance  alone.  The  linear  rule  Incorporating 
the  population  actual  a  priori  odds,  and  the  graphic  rule,  exceed  the 


51 

Snax  criterion*  The  quadratic  rule,  which  performed  well  in  the 
initial  classif icationof  the  development  subsample,  performed  less 
satisfactorily  than  the  others  on  cross-validation.  This  is  consistent 
with  the  sensitivity  of  the  rule  to  nonnormal  distributions  [Lachenbruch, 
1975]. 

TABLE  12.  EFFECTIVENESS  OF  CLASSIFICATION  RESULTS 
COMPARED  TO  CHANCE 


Classification 
Rule :  a  priori 

Total  Correct 
Classification 

Correct 
%  by 
Chance 

%  Correct 
Graduates 

%  Correct 
Failures 

Linear-equal 

77.7% 

66% 

94% 

34% 

Linear-unequal 

88.4  % 

80% 

90% 

64% 

Quadratic-equal 

77.1% 

68% 

92% 

31% 

Graphic 

87.6% 

80% 

89% 

67% 

Appendices  D-F  contain  reproductions  of  the  input  statements  and 
output  produced  (discriminant  function,  classification  equations, 
statistics,  etc.)  by  the  SPSS  Discriminant  procedure  for  the  linear 
equal  and  unequal  a_ priori  assumptions  and  quadratic  procedure. 

Subsidiary  Analysis 

A  separate  analysis  was  run  on  the  data  to  evaluate  the  shape  and 
distributions  of  the  discriminant  scores  when  a  different  sample  is 
selected  and  the  mean  replacement  of  missing  values  is  not  incorporated 
in  either  the  development  sub sample  or  cross-validation  subsample.  This 
was  done  to  evaluate  the  effect  that  mean  replacement  might  have  on  the 


shape  and  means  of  the  group  distributions.  Figure  4  and  Figure  5  show 
the  distributions  when  only  complete  data  sets  are  used  in  all  phases 
of  the  analysis.  It  can  be  seen  that  a  greater  negative  skew  results 
when  mean  replacement  is  avoided  in  the  Graduate  group.  The  distri¬ 
bution  of  the  Failures  appears  to  demonstrate  more  of  a  bimodal  shape 
than  when  mean  replacement  is  used.  It  is  noted  that  the  percent  of 
correct  classifications  for  this  procedure  was  slightly  less  than  that 
obtained  when  mean  replacement  was  used. 

Appendix  G  contains  the  computer  input  and  output  for  the  subsidiary 
analysis. 
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DISCUSSION 


Summary  of  Results 

Results  of  this  study  indicate  that  numerical  ability  is  the 
dominant  predictive  characteristic  of  success  in  the  USAF  Medical 
Laboratory  Specialist  courses.  This  substantiates  the  findings  of 
Roark  [1981]  in  his  study  of  MLS  success  and  is  consistent  with  the 
findings  of  Duteman  et  al.  [1966]  and  those  of  Driver  and  Feeley  [1974] 
who  studied  civilian  medical  laboratory  programs.  Mean  differences 
between  the  groups  (Table  1)  were  most  pronounced  for  the  Mathematics 
Pretest  (MPT)  and  the  highest  correlation  to  Graduation  was  found  in  the 
MPT.  The  aptitude  scores,  xn  general,  did  not  appear  to  be  very  signi¬ 
ficant  in  relation  to  successful  completion  of  the  course.  When  the  MPT 
is  held  constant,  the  highest  aptitude  test  validity  is  .13  (EL).  Thus, 
it  seems  that  not  only  is  numerical  knowledge  being  incorporated  in  the 
MPT,  but  so  are  elements  of  verbal  and  perceptual  aptitudes  that  are 
measured  by  the  other  composites. 

However,  two  considerations  must  be  taken  into  account  before  dis¬ 
missing  the  validity  of  the  aptitude  composites.  First,  Individuals 
entering  the  MLS  course  are  preselected  based  upon  an  acceptable  score 
on  the  General  Aptitude  Index  (GI) .  Eighty-five  percent  of  the  students 
selected  in  this  manner  will,  on  the  average,  pass  the  courses.  This 
alone  demonstrates  high  validity  for  the  GI.  Secondly,  since  explicit 
preselection  has  occurred  on  the  variable,  its  range  has  been  restricted 
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(note  that  the  GI  has  the  lowest  standard  deviation  of  all  the  aptitude 
composites),  and  as  such,  it  will  have  spuriously  lower  correlations  to 
Graduation  [Nunnally,  1978;  Guilford  and  Fruchter,  1978).  It  is  recom¬ 
mended  by  many  that  a  correction  be  made  to  the  correlation  of  the 
restricted  variable  based  on  the  knowledge  of  the  standard  deviations  of 
the  variable  for  both  the  restricted  and  unrestricted  populations 
[Cronbach,  1960;  Gullickson  and  Hopkins,  1976;  Guilford  and  Fruchter, 
1978] .  Such  corrections  assume  linearity  of  regression  and  homoscedastic 
variances  in  the  populations.  Valentine  [1981]  has  found  that  these 
assumptions  were  not  met  for  the  population  during  this  data  collection 
time  frame.  However,  Osbum  and  Greener  [1980],  using  Monte  Carlo  tech¬ 
niques,  found  that  under  moderate  degrees  of  restriction  the  corrections 
are  quite  robust  to  nonnormality  and  deviations  from  linearity.  If 
independence  of  the  test  variables  could  be  assumed,  then  the  corrected 
correlation  for  GI  would  most  likely  be  more  accurate  then  the  corre¬ 
sponding  uncorrected  estimate.  This  is  not  the  case  for  the  variables 
In  this  study.  Due  to  the  moderate  to  high  collinearity,  it  is  apparent 
that  the  "unrestricted"  variables  have  also  been  restricted  implicitly. 

To  adjust  for  explicit  preselection  without  making  corresponding  adjust¬ 
ments  to  the  other  variables  would  make  interpretation  speculative  at 
best.  Thus,  a  correction  is  not  made.  The  best  that  can  be  said  is  that 
the  GI  validity  is  less  than  what  would  be  expected  on  an  unrestricted 
population  and  that  due  to  implicit  preselection  on  the  other  composites, 
they  too  would  most  likely  have  greater  predictive  validity. 

The  moderately  high  correlations  that  both  the  Electronics  and 
General  composites  have  with  the  AFQT  (.77  and  .80,  respectively)  high- 


light  their  resemblance  to  the  general  intelligence  test.  This  is 
especially  apparent  for  the  General,  which  is  the  AFQT  minus  the  spatial 
perception  subtest.  It  appears,  therefore,  that  the  only  criterion  for 
admission  to  MLS  technical  training  is  an  interest,  a  quota,  and  an 
acceptable  general  intelligence.  As  such,  the  USAF's  applied  concept 
of  differential  validity  in  occupational  prediction,  as  exemplified  by 
the  use  of  the  Armed  Services  Vocational  Aptitude  Battery  (ASVAB) ,  does 
not  apply  to  the  MLS  training  program.  In  light  of  the  various  techniques 
of  special  attention  that  course  Instructors  must  provide  to  maintain 
a  low  attrition  level,  i.e.,  special  instruction  time,  remedial  mathema¬ 
tics  training  programs,  retesting  and  recycling  [Hagen,  1981],  and  the 
predominance  of  numerically  related  task  deficiencies  reported  by 
supervisors  and  personnel  in  the  field  [Carroll,  1980],  some  measure  of 
differential  selection  could  be  beneficial.  Since  the  MPT  offers  the 
most  significant  validity  to  graduation,  the  use  of  a  test  of  mathematics 
knowledge  in  preselection  appears  warranted.  This  finding  supports  the 
recommendations  that  were  made  by  Roark  [1981a].  The  use  of  such  a  test, 
incorporated  with  the  present  General  composite,  would  most  likely 
approximate  the  validity  of  the  MPT  (as  noted  previously,  it  appears  that 
the  MPT  is  measuring  more  than  just  mathematics  knowledge) .  In  the 
unrestricted  population,  this  composite  would  probably  be  significantly 
better  than  the  MPT. 

In  the  second  part  of  the  study  a  discriminant  model  was  developed 
to  assess  its  utility  for  discriminating  between  course  Graduates  and 
Failures.  It  is  seen  from  inspection  of  the  classification  tables  in 
Table  9  thru  12,  that  under  appropriate  a  priori  considerations  the 
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LDF  can  predict  with  a  minimum  of  misclassifications  significantly 
better  than  chance.  Also,  the  statistical  evidence  presented  in  cross- 
validation  show  that  the  LDF  will  produce  predictions  that  are  reason¬ 
ably  accurate  and  stable.  This  is  especially  encouraging  in  light  of 
the  deviations  from  theoretical  assumptions;  however,  many  researchers 
have  also  found  this  to  be  true  [Gilbert,  1968;  Eisenbeis  and  Avery, 

1972;  Mark  and  Dunn,  1974;  Pohl,  1974;  Lachenbruch,  1975].  The  question 
then  becomes:  Of  what  utility  is  the  model? 

Probably  the  most  effective  uses  of  the  model  for  course  administra¬ 
tion  would  be  in  the  area  of  counseling  and  remedial  training.  Granted, 
the  classification  of  an  individual  as  a  "Failure"  could  be  rather 
devastating  to  a  person  just  entering  an  occupational  training  program. 
However,  \diat  the  discriminant  classification  of  "Failure"  means  is: 

that  based  on  the  test  scores  and  past  performances  of  students 
in  this  program,  your  scores  indicate  that  you  look  most  like 
those  that  have  failed  the  course  and  that  your  probability  of 
failing  is  higher  than  your  probability  of  graduating. 

Based  on  this  assessment,  appropriate  remedial  training  can  be  instituted 

to  decrease  the  probability  of  failure.  The  ease  of  which  appropriate 

cutoff  points  can  be  established,  either  by  graphic  or  generated 

classification  functions  using  a  priori  information  and/or  costs  of  mis- 

clas8lflcation,  makes  the  model  very  adaptable  to  managerial  control 

of  a  remedial  program.  As  shown  in  Table  8,  the  power  of  the  LDF 

developed  in  this  study  appears  to  be  dominated  by  the  MPT.  It  would 

be  expected  that  for  those  cases  where  failure  is  predicted,  the  student 

most  likely  demonstrated  poor  mathematical  ability.  As  such,  remedial 

training  in  mathematics  might  be  an  appropriate  strategy. 


The  most  interesting  aspect  of  the  LDF,  however,  was  in  the 
descriptive  picture  obtained  by  plotting  the  frequencies  of  the  stand¬ 


59 


ardized  discriminant  scores.  The  scaled  drawing,  shewn  in  Figure  3, 
exhibits  the  moderate  amount  of  overlap  that  exists  between  the  two 
groups  and  the  apparent  bimodal  form  of  the  Failure  group.  Inferring 
from  this,  it  seems  that  two  populations  exist:  one  group  that  can  be 
discriminated  fairly  well,  and  a  second,  larger  group,  which  seems  to 
have  the  ability  to  pass  (based  on  the  variables  used),  and  which  cannot 
be  discriminated  from  the  Graduates  without  incurring  a  large  mlsclassi- 
fication  rate.  One  explanation  that  is  proposed,  is  based  on  the 
literature  dealing  with  predicting  laboratory  training  success  in 
college.  Various  studies  have  shown  that  the  majority  of  college  fresh¬ 
man  entering  a  medical  technology  curriculum  have  a  general  lack  of  know¬ 
ledge  of  the  task  requirements  in  the  different  health  fields  [Duteman 
et  al.,  1966;  Youse  and  Clark,  1977;  Gleich,  1978],  Also,  Rausch  and 
McClune  [1969]  found  in  a  study  of  college  freshman,  that  those  leaving 
medical  technology  programs  showed  a  greater  interest  in  social  service 
than  the  medical  technology  graduates.  This  may  be  supported  by  Duteman 
et  al.  [1966]  who,  when  attempting  to  discriminate  between  the  different 
allied  health  care  fields,  found  that  medical  technology  graduates  score 
lower  than  the  other  health  care  fields  on  a  scale  of  personal  inter¬ 
action.  Enlistees  entering  the  USAF  and  desiring  of  a  health  care  field 
may  find  the  clinical  laboratory  curriculum  not  meeting  their  expecta¬ 
tions.  This  may  be  especially  critical  for  the  young  enlistee  who  is 
entering  his/her  first  job  experience.  In  most  cases,  recruiters  surely 
examine  the  cognitive  aptitudes  of  the  applicant  for  assignment  purposes 


and  may  even  handle  some  noncognitive  aspects  in  a  subjective  manner.  It 
is  most  likely  that  task  specifics  and  the  amount  and  type  of  patient 
contact  are  not  discussed.  Since  academic  failures  in  MLS  training  are 
typically  reassigned  into  other  health  care  training  programs  at  the 
School  of  Health  Care  Sciences,  where  job  specific  numerical  and  tech¬ 
nical  requirements  are  less  than  in  MLS  school,  it  may  be  that  the  stu¬ 
dent  dealing  with  unmet  expectations,  finds  his/her  motivation  becoming 
one  of  reassignment  rather  than  academic  proficiency. 

Expectations  however,  appear  to  be  only  one  aspect  of  a  growing 
body  of  military  technical  training  research  supporting  the  use  of  non¬ 
cognitive  measures  in  placement.  Guinn  et  al.  [1977],  in  their  study 
of  Security  Police  training,  found  that  interests  were  of  practical 
value  in  prediction  of  training  success.  Hoiberg  and  Pugh  [1978]  and 
Webster  et  al.  [1978]  found  life  history  items,  motivation,  expectations, 
and  personality  to  be  factors  in  persistence  in  training.  Supported  by 
the  growing  evidence,  the  inclusion  of  noncognitive  variables  into  the 
discriminant  function  may  not  only  alleviate  the  bimodal  situation  but 
also  improve  discrimination. 

The  final  objective  of  this  study  was  to  evaluate  the  use  of  the 
IDF  in  light  of  the  recommendations  of  Maginnis  et  al.  [1975]  for  an 
optimal  aptitudes  requirements  system.  A  IDF  could  be  very  functional 
in  establishing  and  modifying  the  aptitude  requirements  for  entry  into 
MLS  training.  When  utilized  on  an  unrestricted  population  with  tests 
of  specific  aptitudes,  optimal  composites  to  a  criterion  of  Graduation 
could  be  obtained.  Furthermore,  based  on  manpower  requirements,  the 
costs  of  misclassification  could  be  easily  adjusted  by  one  change  to  the 
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constants  of  the  classification  rules  or  simple  adjustment  to  the  cutoff 
score,  thus,  allowing  more  selective  or  less  selective  entry  with 
accurate  estimates  of  misclassif ication. 

The  Graduate/Failure  criterion,  plus  the  inclusion  of  noncognitive 
measures  into  the  model,  deemphasizes  the  question  of  how  well  ran  I 
perform  in  the  training,  but  does  answer  the  question  of  what  group  do 
I  most  resemble  in  the  training  program.  Minimal  versus  maximal  per¬ 
formance  in  training  is  not  a  criterion.  This  might  be  appropriate  when 
the  findings  of  Ghiselli  [1966]  are  taken  into  account;  that  is,  training 
performance  does  not  necessarily  predict  proficiency  on-the-job.  Specific 
weaknesses  are  best  left  to  training  instructors  who  can  design  a  program 
of  study  to  meet  the  needs  of  their  students  and  their  occupational 
specialty . 


Limitations 

TVo  population  effects  were  encountered  during  the  time  frame  of 
the  study  that  need  to  be  addressed.  First,  in  April  1980,  the  score 
required  for  passing  course  tests  was  raised  from  60Z  to  70Z  and  the 
recycling  capability  of  test  failures  was  reduced  to  maintain  favorable 
student/ teacher  ratios  [Hagen,  1981].  A  review  of  the  discriminant  scores 
in  the  failure  group  was  accomplished  to  see  if  increased  failures 
could  have  affected  the  shape  of  the  student  distributions.  The  following 
percentages  were  found  in  the  smaller  mode  of  the  failure  distribution; 

71Z  for  the  five  months  evaluated  in  FY78,  36Z  for  FY79,  and  23Z  for  FY80. 
This  seems  to  demonstrate  a  general  trend  towards  more  failures  locating 
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In  the  larger,  less  discriminating  mode.  This  would  be  consistent  with 
progressively  higher  standards  being  applied  to  the  training  pass- 
criterion  and/or  lessened  ability  to  perform  remedial  efforts. 

The  second  limitation  deals  with  the  percentile  metric  normlng  pro¬ 
cedure  that  was  used  by  the  USAF  during  the  period  when  ASVAB  Forms  6/7 
were  being  used.  Valentine  [1981]  noted  that  beginning  with  the  use  of 
these  Forms  and  up  until  October  1980,  a  nonlinear  error  in  normalizing 
the  aptitude  scores  occurred.  This  had  the  effect  of  increasing 
reported  scores  above  that  which  was  correct.  As  such,  lower  aptitude 
personnel  may  have  been  admitted  to  some  programs  where  higher  standards 
applied.  He  also  noted  a  study  done  by  Simm  and  Truss  [1979]  that  found 
that  the  ranking  of  student  aptitudes  was  not  changed.  For  the  study, 
this  effect  was  held  constant  by  the  inclusion  of  only  those  personnel 
that  took  the  ASVAB  Forms  6/7.  This  is  based  on  the  assumption  of 
attendance  in  military  basic  training  for  those  students  evaluated  in 
late  November  and  early  December  classes  of  FY80.  One  by-product  of 
this  norming  error  may  have  been  to  increase  the  frequency  of  students 
in  the  larger  mode  of  the  Failure  group.  Since  their  aptitude  scores  are 
higher  than  actuality,  they  would  appear  to  be  of  higher  ability,  yet 
eventually  fail.  However,  it  is  felt  that  this  bias  is  not  a  significant 
factor  in  the  apparent  blmodal  distribution.  This  is  due  to  the  fact 
that  the  dominant  variable  in  the  discriminant  function  is  the  MPT.  The 
MPT  is  given  after  assignment  to  the  MLS  course,  thus,  not  affected  by 
the  norming  error. 


Suggestions  for  Further  Research 

The  one  aspect  of  the  study  that  seems  to  require  further  research 
is  the  determination  of  what  factors  are  responsible  for  the  bimodal 
distribution  in  the  Failure  group.  It  may  be  that  if  appropriate  meaures 
are  taken  to  include  mathematical  knowledge  as  a  prerequisite  to  course 
admission,  this  shape  could  change,  quite  likely  in  the  form  of  reducing 
the  most  easily  discriminated  mode  of  the  Failure  group.  The  answer 
to  the  larger  proportion  of  failures  may  lie  in  assessing  noncognitive 
aspects  of  the  individuals  entering  the  program.  A  longitudinal  study 
spanning  both  training  and  on-the-job  attrition,  using  cognitive  and 
noncognitive  measures,  might  be  able  to  define  those  variables  significant 
to  training  and  retention  in  the  field. 

Secondly,  based  on  the  literature  dealing  with  aptitudes  and  inter¬ 
ests  of  laboratory  personnel  and  their  apparent  differences  from  other 
allied  health  fields,  it  may  be  helpful  to  determine  if  it  is  still 
appropriate  to  compare  MLS  technical  training  requiements  to  that  of  the 
other  allied  health  specialties. 

Thirdly,  a  study  of  present  procedures  used  by  recruitment  personnel, 
when  counseling  prospective  employees  on  the  USAF  Medical  Laboratory 
Specialist  career  field,  would  offer  an  assessment  of  weaknesses  in  that 
effort.  An  approach  aimed  at  defining  the  task  requirements  of  this 
career  field  may  not  only  bring  persons  interested  in  a  highly  technical 
field  into  the  MLS  program,  but  would  also  enlighten  applicants  to  the 
relative  independence  of  this  career  from  that  of  the  other  allied 


health  sciences. 
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Also,  a  follow-up  study  using  the  raw  scores  obtained  by  MLS 
students  on  each  subtest  would  remove  any  effects  that  inaccurate 
norming  might  have  had  and  also  allow  for  a  direct  approach  to  the 
assessment  of  specific  subtest  validity. 

Conclusions 

From  the  preceding  data,  it  has  been  concluded: 

1.  The  most  effective  predictor  of  graduation  in  courses 
J3ABR90430,  Medical  Laboratory  Specialist  (Phase  I)  and 
J5AZ090450,  Medical  Laboratory  Specialist  (Phase  II)  combined, 
is  the  course-developed  Mathematics  Pretest  (MPT) . 

2.  The  most  powerful  discriminator  between  Graduates  and  Failures 
in  the  Linear  Discriminant  Function  developed,  is  the  course- 
developed  Mathematics  Pretest; 

3.  The  frequency  curve  of  the  discriminant  scores  for  Graduates 
appears  to  approach  that  of  the  frequency  curve  of  a  normal 
distribution,  but  does  demonstrate  a  slight  negative  skew; 

4.  The  frequency  curve  of  the  discriminant  scores  of  Failures 
appears  to  be  blmodal  in  shape,  with  approximately  34%  of 
the  group  in  the  smaller  mode  (which  is  most  distant  from 
the  Graduate  mean); 

5.  A  Linear  Discriminant  Function  utilizing  unequal  £  priori 
odds  of  graduating  and  failing  was  able  to  produce  a  stable, 
and  accurate  classification  of  Graduates  and  Failures  with 


a  minimum  of  misclassifications  on  cross-validation; 
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6.  The  use  of  a  Linear  Discriminant  Function  is  effective  for 
evaluating  the  importance  of  specific  aptitudes  for  differen¬ 
tiating  Graduates  from  Failures  in  training,  and  is  easily 
modified  to  take  into  account  differing  a^  priori  odds  of 
membership  and/or  differing  costs  of  misclasslfication. 
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APPENDIX  A 

The  Armed  Services  Vocational  Aptitude  Battery  (ASVAB) 

Forms  5,  6,  7 


Composites 

APQT . WK  +  AR  +  SP 

Mechanical  Aptitude  (MI) . AI  +  MC  +  SI 

Administrative  Aptitude  (GI) . WK  +  AD  +  NO 

General  Aptitude  (GI) . WK  +  AR 

Electronics  Aptitude  (EL) . AR  +  SP  +  EL 


Sub tests 


1.  Ntmerical  Operations  (NO):  measures  how  rapidly  and  accurately  a 
subject  can  complete  arithmetic  operations,  such  as  addition, 
subtraction  ,  multiplication  and  division.  Fifty  item  speeded 
test  with  three  minute  time  limit. 

2.  Attention  to  Detail  (AD):  designed  to  measure  the  aptitude  to 
perceive  simple  relationships,  to  store  these  relationships 
mentally,  and  to  decide  upon  them  quickly  and  accurately.  The 
subject  is  presented  with  30  items,  each  comprised  of  two  lines 

of  O' s  with  a  varied  number  of  C's  mixed  in,  and  asked  to  indicate, 
for  each  item,  the  total  number  of  C's  in  both  lines.  Five  minute 
speeded  test. 

3.  Word  Knowledge  (WK) :  an  index  of  verbal  comprehension  that  is 
dependent  upon  the  aptitude  to  understand  written  and  spoken 
language.  It  is  a  ten  minute  word  comparison  test. 

4.  Arithmatic  Reasoning  (AR) :  constructed  to  measure  general  reasoning 
which  is  dependent  upon  the  aptitude  to  solve  arithmetic  word 
problems. 

5.  Space  Perception  (SP):  entails  the  skill  to  visualize  and  manipu¬ 
late  objects  in  space.  Subjects  are  presented  pictorial  items, 
each  consisting  of  flat  patterns  and  four  drawings  of  three  dimen¬ 
sional  figures.  Broken  lines  indicate  where  the  figure  is  to  be 
folded.  Subject  must  decide  which  pattern,  when  folded,  equals 
the  three  dimensional  figure. 
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6.  Electronics  Information  (El):  an  index  of  the  cognitive  aptitude 
to  use  acquired  electronics  relationships,  symbols,  principles, 
and  diagrams. 

7.  Mechanical  Comprehension  (MC) :  the  subject  is  presented  with 
pictorial  items  and  asked  to  indicate  what  they  represent. 

Familiarity  with  ordinary  tools  and  mechanical  relations  is  a  pre¬ 
requisite. 

8.  Shop  Information  (SI):  an  index  of  an  aptitude  that  is  dependent 
upon  knowledge  about  and  experience  with  variety  of  tools  found 
in  a  shop. 

9.  Automotive  Information  (AI):  measures  aptitude  pertaining  to  diag¬ 
nosis  of  automobile  malfunction,  use  of  specific  automotive  parts, 
operation  of  automotive  components  and  knowledge  of  auto  terminology. 


Forms  8,  9,  10 


Composites 

AFQT . 

Mechanical .... 
Administrative 

General . 

Electrical. . . . 


AR  +  WK  +  PC  +  NO 
GS  +  A/ SI  +  MC 
WK  +  PC  +  NO  +  CS 
AR  +  WK  +  PC 
GS  +  AR  +  MK  +  EL 


Sub tests  (other  than  those  already  noted) 

10.  General  Science  (GS) :  measures  knowledge  of  physics  and  biology 
and  reasoning  involved  to  perceive  relationships  between  scientific 
concepts. 

11.  Mathematics  Knowledge  (MK) :  index  of  the  aptitude  to  use  mathema¬ 
tical  relationships  involved  in  solving  problems  in  algebra, 
geometry,  fractions,  decimals,  and  exponents. 

12.  Coding  Speed  (CS) :  evaluates  ability  to  quickly  and  accurately 
assign  coded  numbers  by  relating  them  to  specific  words.  Tests 
clerical  aptitude  in  speeded  operations. 


A 


»qn] 


graduates  in  a  computer-managed  Course  using  measures  of  cognitive 
styles,  abilities,  and  aptitudes.  NPRDC-TR-79-21.  Navy  Personnel 
Research  and  Development  Center,  San  Diego,  Calif.,  1979. 

Information  on  composites  taken  from: 

Department  of  Defense.  ASVAB  Recruiter* s  Guide.  Military  Enlistment 
Processing  Command,  Ft.  Sheridan,  Illinois,  1976. 
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APPENDIX  B 

Linear  Discriminant  Function  Computation 

The  solution  of  the  discriminant  function  problem  requires  deter¬ 
mining  the  weights  to  be  given  to  each  of  the  p  original  variables 
so  that  the  resulting  composite  score  will  have  maximum  utility  for 
discriminating  between  the  groups.  The  function  is  of  the  form: 


Y  -  a^  +  a2x2  + 


+  a  x 
P  P 


(1) 


where  a^,  a2>  ...  ,  a^  are  the  weighting  coefficients  to  be  applied  to 
the  p  original  scores  for  each  subject.  The  problem  then  becomes  the 
determination  of  optimal  weighting  values  such  that  the  distance  between 
the  mean  scores  for  the  two  groups  is  maximized  relative  to  the  variation 
within  groups.  The  function  to  be  maximized  as  defined  by  R.  A.  Fisher 
[1936]  is  the  ratio  of  between-groups  variance  to  the  within-groups 
variance.  In  matrix  notation  this  is 


n^n2  a'dd'a 
^ai^  n.  +  n„  a"  Ca 


(2) 


where  d'  -  [d^  d2  ....  d^]  is  the  vector  of  mean  differences  on  the  p 
original  variables  and  C  is  the  within-groups  covariance  matrix. 
Maximizing  f (a^)  yields  a  set  of  equations  that  can  be  solved  in  matrix 
notation  by: 

Ca  -  d  (3) 

Premultiplication  of  both  sides  by  C~*  yields  the  equation  from  which 
vector  a  can  be  obtained: 

a  -  C_1d  (A) 
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The  mean  values  for  the  discriminant  function  can  be  obtained  by: 


i<»  -  +  a2xf>  + 


+  a  x(1) 
P  P 


(5) 


?(2) 


„  -(2)  -(2) 
aixi  +  a2x2 


with  variance: 


.  «  ;(2> 
+  a  x 
P  P 


(6) 


V(Y)  «  a'Ca  =  a’CC^Ca  -  d'C_1d.  (7) 

With  the  assumption  of  multivariate  normal  distribution  within  groups, 
the  discriminant  function  scores  can  be  seen  to  have  a  normal  distribu¬ 
tion  within-groups,  with  mean  values  and  and  standard  devia¬ 

tion  a  “\/d '  a".  As  such  the  deviation  of  an  individual  score  from  each  of 
the  groups  can  be  reguarded  as  a  unit-normal  deviate  of  Z  score: 


*Y 


Y  -  Y(1) 
V(Y) 


(8) 


where  i  -  1,2.  Thus  for  any  particular  discriminant  function  score, 
say  Yc>  the  Z-scores  deviation  from  each  group  can  be  computed.  For 
example: 

Group  1  Group  2 


Die  discriminant  function  score  Yfi  can  be  accepted  as  a  cutting  point 
for  classifying  individuals  into  the  two  groups.  By  converting  the  dis¬ 
criminant  score  Yfi  to  Z-score  by  Eq.  (8)  and  referring  to  the  unit- 
normal  distribution  tables,  the  proportion  of  misclasslfications  can  be 
obtained  for  each  group. 
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Information  taken  from: 

Overall,  J.  E.,  Klett,  J.  C.  Applied  multivariate  analysis.  New  York: 
McGraw-Hill,  1972. 


APPENDIX  C 

SPSS  CLASSIFICATION  FUNCTIONS 


j 

i 

i 


.1 


75 


APPENDIX  C 

SPSS  Classification  Functions 

The  SPSS  classification  functions  are  based  on  posterior  probabil¬ 
ities,  that  is,  probabilities  that  the  individual  belongs  to  each  of 
the  given  groups,  given  the  subject's  values  on  each  of  the  discrimi¬ 
nating  variables.  The  classification  functions  are  of  the  form: 

d±(x)  -  (X-*s  5(1V  2_1  <x(i)) 

where  X?  *  (x^,  x^,  ..  .  ,  xp)»  2  *  S  *  sample  pooled  within-groups  co- 
variance  matrix,  and  i  -  1,2.  Thus  two  classification  functions  are 
produced  in  the  two-group  case.  Given  a  random  vector  Z'  ■  (Z^,  Z^, 

. . . ,  Zip)  that  came  with  equal  probability  from  each  of  q  normal  popula¬ 
tions  with  mean  vectors  y^,  y£,  ....  y^,  and  common  covariance  matrix 
X,  the  posterior  probability  that  Z  is  from  the  gth  population  is  given 
by: 

P(g/Z)  -  k  {exp[-Js(Z-yg)'  Z  1  (Z-  yg)]>. 

Replacing  parameters  with  sample  estimates  and  choosing  k  (constant) 
so  that  the  sum  over  all  q  groups  of  P(g/Z)  -  1  gives: 

q 

P(g/Z)  -  exp(dg(Z))/  Z  exp(dg(Z)). 

q-1 

The  function  d^  which  has  the  largest  value  at  Z  corresponds  to  the  group 
with  the  greatest  (estimated)  posterior  probability  given  Z.  The  new 
case  will  be  classified  in  the  group  corresponding  to  the  largest 
*(i/Z). 

In  the  case  of  a  priori  probabilities,  the  natural  log  of  the  a 
priori  probability  is  added  to  the  appropriate  group  constants. 
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